Question

I had an argument with a colleague about writing python efficiently. He claimed that though you are programming python you still have to optimise the little bits of your software as much as possible, as if you are writing an efficient algorithm in C++.

Things like:

• In an if statement with an or always put the condition most likely to fail first, so the second will not be checked.
• Use the most efficient functions for manipulating strings in common use. Not code that grinds strings, but simple things like doing joins and splits, and finding substrings.
• Call as less functions as possible, even if it comes on the expense of readability, because of the overhead this creates.

I say, that in most cases it doesn’t matter. I should also say that context of the code is not a super-efficient NOC or missile-guidance systems. We’re mostly writing tests in python.

What’s your view of the matter?

Answer 1

My answer to that would be :

We should forget about small
efficiencies, say about 97% of the
time: premature optimization is the
root of all evil.

(Quoting Knuth, Donald. Structured Programming with go to Statements, ACM Journal Computing Surveys, Vol 6, No. 4, Dec. 1974. p.268)

If your application is doing anything like a query to the database, that one query will take more time than anything you can gain with those kind of small optimizations, anyway…

And if running after performances like that, why not code in assembly language, afterall ? Because Python is easier/faster to write and maintain ? Well, if so, you are right 🙂

The most important thing is that your code is easy to maintain ; not a couple micro-seconds of CPU-time !

Well, maybe except if you have thousands of servers — but is it your case ?