Allowed memory size of 33554432 bytes exhausted

nidhimittal · June 20th, 2006, 03:18 AM

my php program is quering database brings data after
querying and processes it ..my database is postgresql and data which it
brings is more in number so i used query instead of getAll functiion of pear
can somebosy please guide me what can be the reason behind it ???
Thanks a lot
Nidhi Mittal

nidhi

richard.york · June 20th, 2006, 09:47 AM

Use functions such as pg_free_result() to free up memory after processing a query.

http://www.php.net/pg_free_result

I'm not familiar with PEAR's database wrappers, but I'm sure there's something like that in there.

Otherwise, increase PHP's memory limit in php.ini.

Regards,
Rich

--
Author,
Beginning CSS: Cascading Style Sheets For Web Design
CSS Instant Results

http://www.catb.org/~esr/faqs/smart-questions.html

nidhimittal · June 21st, 2006, 12:19 AM

thanks a lott sir
i tried to increase the memory limit in php.ini from 32 MB to 64 MB
it is still giving the same message my total RAM is 256 MB
somebody suggetsed me to put -1 in php.ini Memory Limit
i did it rather i put
Memory Limit =1024 MB
it worked okay ...
but i feel it was a wrong solution ..

and let me try your first solution thanks a lott
nidhi mittal
India

nidhi

nidhimittal · June 22nd, 2006, 05:03 AM

hi sir
i tried $res->free(); dat's a function of pear for the same purpose
but same error is coming ..
please guide me some other solution i really need it

nidhi

richard.york · June 22nd, 2006, 07:25 AM

Now would be a good time to post some code so we can see what's going on. Just the relevant snips will do.

Regards,
Rich

--
Author,
Beginning CSS: Cascading Style Sheets For Web Design
CSS Instant Results

http://www.catb.org/~esr/faqs/smart-questions.html

nidhimittal · June 23rd, 2006, 02:52 AM

do
  {
     $empno=$row['empno'];
    //echo"<BR> empno obtained is $empno";
    $information='';
    foreach($row_key_array as $key)
   {
    $field_name=$key;
    $field_id = $field_id_arr[$field_name];
    $information= $row[$field_name];
    $keyword_arr=array();
    $keyword_arr=$searchengine->separate_keywords($information);
    foreach($keyword_arr as $keyword)
    {
      $keyword=$searchengine->keyword_processing($keyword);
    if($keyword!='NO-KEYWORD' and $keyword!='IRRELEVENT')
   {
      $keyword=addslashes($keyword);
      $keyword_id=$searchengine->addkeyword($keyword);
      $add_emp_result=$searchengine->addempno($keyword_id,$empno,$table_id,$field_id );
   }
  }//for each keyword_arr
  }//for each row_key_array

}while($main_result->fetchInto($row,DB_FETCHMODE_ASSOC));

DESCRIPTION:

for every employee number this while loop works and there are two functions shown in the code addkeyword(----) and addempno(----)
both functions add something to the databse tables
that means both contains "insert" statements
no doubt there are hundreds of employees and for each employee there are many keywords and for each of those keywords these two functions are called ...

if you wish to see now i will paste these two functions code also

but i feel there is some memory exhaustion problem like somewhere
script is occupying the whole memory without freeing earlier occupied one....
please see and reply...
and one more thing can you please reply in day time as i get your reply after 24 hrs ...
Thanks
nidhi

nidhi

richard.york · June 23rd, 2006, 10:37 PM

I still don't have enough information to form any recommendations, it seems. I'd have to see what's going on in these methods that are being called.

Why do you need to split keywords? Is this some effort to recreate a fulltext index? I don't know much about pgsql, but if I were you I'd look into built-in tools for database optimization. Typically this will involve creating indexes on your database tables, which facilitate more efficient retrieval of data.

http://www.devx.com/opensource/Artic...4/1954?pf=true

Some time with Google ought to help you with this one.

You can form some stats for yourself, time the execution of each function to narrow it down. You can do that with a microtime function.

Code:

function microtime_float()
{
    list($usec, $sec) = explode(' ', microtime());
    return ((float)$usec + (float)$sec);
}

Then to do a benchmark, place the following where you want to begin the benchmark...

Code:

$time_start = microtime_float();

...and the following where you want to end the benchmark...

Code:

echo round((microtime_float() - $time_start), 2);

This will give you the time of execution in seconds. If you have anything over a second, your program is taking entirely too long to execute. You can use a technique like this to narrow down the bottleneck to a particular snippet of code. Most web-based applications do their business in a fraction of a second, and if you're spending that much memory, I'd venture to say that time is also an issue.

It really sounds like you need fulltext indexing on your database tables which would eliminate the need for spliting up keywords and that sort of thing, but I'm just speculating, as again, I'd need to see what those functions are doing to know for sure.

The other thing you can do is implement garbage collection. After everything you do in your script, be sure to clean up after yourself. unset() variables after you're finished with them. Close connections to outside services. Free result sets after you're done with a query (as mentioned in my previous post).

Regards,
Rich

--
Author,
Beginning CSS: Cascading Style Sheets For Web Design
CSS Instant Results

http://www.catb.org/~esr/faqs/smart-questions.html