How to free memory after array in PHP? unset and = null seems to not working -


i ve got 16 mb size csv file , try parse it, , stuff, script run out of memory after time. realize code generate around 200 mb of used space , unset not working.

    $countrows = 1;     var_dump("3. ".memory_get_usage()." begindiff: ".(memory_get_usage() - $this->startingmemory));     while(($row = fgetcsv($fp, 300000, ';', '"')) !== false)     {         if ($row == '')             continue;          if($firstrow == true)         {             foreach($row $k => $v)             {                 $this->columnmapping[$k] = trim(mb_strtolower($v));             }             $firstrow = false;             continue;         }else         {             foreach($row $k => $v)             {                 $row[$this->columnmapping[$k]] = $v;                 unset($row[$k]);             }         }     ...         //$this->theircategoriestoproducts[$row['kategorie']][]['kodproduktu'] = $row['kodproduktu'];         $this->theircategoriestoproducts[$row['kategorie']][] = $row;     }     var_dump("3,5.  ".memory_get_usage()." begindiff: ".(memory_get_usage() - $this->startingmemory));     ...     var_dump("7. - before unset total: ".memory_get_usage()." begindiff: ".(memory_get_usage() - $this->startingmemory));     unset($this->theircategoriestoproducts);     var_dump("8. - after unset total: ".memory_get_usage()." begindiff: ".(memory_get_usage() - $this->startingmemory));die;

generating output:

    string '3. 72417440 begindiff: 34730040' (length=31)     string '3,5.  292748528 begindiff: 255061136' (length=36)     string '7. - before unset total: 299039360 begindiff: 261351984' (length=55)     string '8. - after unset total: 297364432 begindiff: 259677056' (length=54)

with setting variable equals null output similar. switching comments between 2 lines

    $this->theircategoriestoproducts[$row['kategorie']][]['kodproduktu'] = $row['kodproduktu'];     //$this->theircategoriestoproducts[$row['kategorie']][] = $row;

will output:

    string '3. 72417784 begindiff: 34730040' (length=31)     string '3,5.  81081984 begindiff: 43394248' (length=34)     string '7. - before unset total: 87256544 begindiff: 49568824' (length=53)     string '8. - after unset total: 85581520 begindiff: 47893800' (length=52)

so 200 mb of "lost" memory (almost half of dedicated).

recursive function unseting parts of arrays eat more memory, able free crashed also.

in script never used array & there should no references other variables.

file closing right after 3.5 dump.

any other ideas, how unset array?

as of php > 5.3 there garbage collection mechanisms available, theoretically think of example in docs

//memory cleanup long-running scripts. gc_enable(); // enable garbage collector var_dump(gc_enabled()); // true var_dump(gc_collect_cycles()); // # of elements cleaned gc_disable(); // disable garbage collector

but unfortunately, in case have bear in mind (according can trigger php garbage collection happen automatically if have circular references?) garbage collector "will not run, example, when memory limit hit. result, script can still abort when hitting memory limit because php dumb collect cycles in case!".

in end, can try using gc, possibly won't solve problem.

so, else there try? try splitting master data array import smaller chunks , import them sequentially 1 after another. fetch chunks in loop same variable , loop through process records.


Comments

Post a Comment

Popular posts from this blog

image - ClassNotFoundException when add a prebuilt apk into system.img in android -

i'm in trouble add prebuilt apk system.img based taiwan mtk android phone platform, when push apk onto device,after reboot phone,the apk can installed succecessfully,but if add apk alps/out/target/product/$prj/system/app or vendor/mediatek/$prj/artifacts/out/target/product/$prj/system/app ,and produce system.img,the apk can't installed normally,the logcat say: a.lang.runtimeexception: unable instantiate activity componentinfo{com.sec.android.widgetapp.ap.hero.accuweather.widget/com.sec.android.widgetapp.ap.hero.accuweather.widget.weatherclock}: java.lang.classnotfoundexception: com.sec.android.widgetapp.ap.hero.accuweather.widget.weatherclock. can tell me what's problem ? when package manager installs apps part of system partition different installing apps on data partition. looks app using libraries somewhere else. when install on data lib directory created in apps data directory , symlinked /data/app-lib/. when apps installed on system it's expecte...
Read more

I need to import mysql 5.1 to 5.5? -

i have mysql 5.1 database , need import localhost running 5.5. how import 5.5 or downgrade mysql? install phpmyadmin 5.1 os: http://www.wikihow.com/install-phpmyadmin-on-your-windows-pc or https://www.digitalocean.com/community/articles/how-to-install-and-secure-phpmyadmin-on-ubuntu-12-04 then login, click on database, hit export, , export in sql format (quick fine). import .sql file 5.5 server (after installing phpmyadmin) logging in clicking database , hit import. hope helps!
Read more

Java, Hibernate, MySQL - store UTC date-time -

i saw here on few related questions (like this one , of course, this one )... essentially, want store date-time utc, , let application user choose time zone wants display date-time in. since seems date-time fields affected underlying jdbc driver, wonder if acceptable way go storing utc date-time: set both mysql , application server machine utc time zone (no need separate) both mysql , jvm should pick underlying system time settings (if not instructed otherwise) use datetime table columns on mysql side use java.util.date corresponding mapping on hibernate side (i guess java.sql.timestamp used too) let application worry interpreting date-time fields - i.e. let user choose preferred time zone is ok? edit clarify - here meant refer timestamps created strictly on server (e.g.date-time of record creation). application server instantiates date objects (new date() equals current date-time on server, , time zone agnostic). if client user wants supply date searching/filte...
Read more