Python Django load MySQL database from csv files performance issue?
12th February 2012
My answer to Python Django load MySQL database from csv files performance issue? on Quora
Don’t use the Django ORM for bulk imports—the performance overhead is pretty small for regular web page stuff, but it adds up if you are running millions of inserts.
Either write your import code to call MySQLdb directly or use the mysqlimport command line tool.
More recent articles
- Qwen2.5-Coder-32B is an LLM that can code well that runs on my Mac - 12th November 2024
- Visualizing local election results with Datasette, Observable and MapLibre GL - 9th November 2024
- Project: VERDAD - tracking misinformation in radio broadcasts using Gemini 1.5 - 7th November 2024