Hi

 

I have a job to export data from over 400,000 documents to a table in MySQL. The table in MySQL has 187 columns in it - not ideal or even close to being normalised I know. The issue I'm finding that I'm watching memory just disappear when I run. To the point that after 3000 records inserted memory's gone from 3.1gb used to 6.5gb used.

 

My connection settings are

 

    Set lcConnection= New LCConnection("ODBC2")
    lcConnection.server="xxxxxxx"
    lcConnection.userID=ASPXUserName
    lcConnection.password=ASPXPSW
    lcConnection.metaData="database.table"
    lcConnection.mapByname=True
    lcConnection.Connect

In my write section, after doing lots of adds to fields I'm doing...

 

    lcConnection.insert fields
    lcConnection.action LCACTION_RESET
    Set fields=Nothing

 

The above hasn't seemed to cleared any memory, just keeps climbing. I put in the LCACTION_RESET as a guess but doesn't seem to help. Is there a setting I'm missing in the connection? The version of MySQL we have is quite old 5.022, but I am using the most current ODBC driver. We have been promised an updated version by our Sys Admin, but it's a waiting game.  Also, if normalising the tables may be a solution let me know.

 

This is a one off initial load, from there on it'd be a nightly agent to add/update documents changed during the day. Am concerned that if the memory leaks at this stage what will be the effect long term.

 

Any suggestions welcome.

 

Thanks

 

Cameron