Over the next 2 weeks I'll be building a data transformation app that will export approximately 50,000 product records from a retail store's POS system to a website. Not hard - but there are some challenges....
Basically I'm working with very limited resources: they have a home style 1.5mb down/256k up internet connection, the website is hosted on a shared server, and the database is on a shared SQL server with probably too many other databases. A batch update is not allowed by the host, so I have to loop through each record and insert or update 50000 times without bringing the webserver or SQL server to it's knees. It also has to be done at least once a day. I'm aiming for an hour to complete the entire operation.... I reckon I could come close, but hey - hopefully it'll be better then the last guy's efforts of 9 hours.
ahhhh i love a physical challenge.
Wednesday, August 29, 2007
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment