Fw: [SPSSX-L] optimizing code and speedups

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Fw: [SPSSX-L] optimizing code and speedups

Jon K Peck


Jon Peck (no "h") aka Kim
Senior Software Engineer, IBM
[hidden email]
phone: 720-342-5621



There is an extension command STATS BENCHMRK that can measure performance for alternative versions of jobs.  It does not profile the code, but it interleaves the versions so as to minimize the effect of machine state, and it produces an SPSS-readable dataset of various measures including time, memory, swapping etc.  It's Windows only.

For Python code in particular, the cProfile module, which is part of the Python standard library, is quite easy to use.


Jon Peck (no "h") aka Kim
Senior Software Engineer, IBM
[hidden email]
phone: 720-342-5621

Reply | Threaded
Open this post in threaded view
|

Re: Fw: [SPSSX-L] optimizing code and speedups

Albert-Jan Roskam
That requires win32api to be installed, right? Ha, I just installed that today in the office! I tried STATS BENCHMARK  before, but it should work now.

 
Regards,
Albert-Jan

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
All right, but apart from the sanitation, the medicine, education, wine, public order, irrigation, roads, a
fresh water system, and public health, what have the Romans ever done for us?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 

From: Jon K Peck <[hidden email]>
To: [hidden email]
Sent: Friday, July 12, 2013 6:43 PM
Subject: [SPSSX-L] Fw: [SPSSX-L] optimizing code and speedups



Jon Peck (no "h") aka Kim
Senior Software Engineer, IBM
[hidden email]
phone: 720-342-5621



There is an extension command STATS BENCHMRK that can measure performance for alternative versions of jobs.  It does not profile the code, but it interleaves the versions so as to minimize the effect of machine state, and it produces an SPSS-readable dataset of various measures including time, memory, swapping etc.  It's Windows only.

For Python code in particular, the cProfile module, which is part of the Python standard library, is quite easy to use.


Jon Peck (no "h") aka Kim
Senior Software Engineer, IBM
[hidden email]
phone: 720-342-5621