If you ditch all but the 10-or-so vars you need, your data is about 15.7Gb (assuming it's all numeric) uncompressed. Enough to even keep the whole thing in core.
I've processed 500M datasets with much less memory. Ok, it takes a while (I speak fluent Mandarine Chinese now), but it works.
Cheers!!
Albert-Jan
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
All right, but apart from the sanitation, the medicine, education, wine, public order, irrigation, roads, a
fresh water system, and public health, what have the Romans ever done for us?
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>________________________________
> From: drfg2008 <
[hidden email]>
>To:
[hidden email]
>Sent: Wednesday, February 8, 2012 6:03 PM
>Subject: Re: [SPSSX-L] SPSS 20 + 64 bit OS
>
>/What for crying out loud are you doing which would conceivably require more
>than 16G. /
>
>David,
>68.774.810 rows / 4798 variables -> GLM
>
>Bye,
>Frank
>
>-----
>Dr. Frank Gaeth
>FU-Berlin
>
>--
>View this message in context:
http://spssx-discussion.1045642.n5.nabble.com/SPSS-20-64-bit-OS-tp5166219p5467049.html>Sent from the SPSSX Discussion mailing list archive at Nabble.com.
>
>=====================
>To manage your subscription to SPSSX-L, send a message to
>
[hidden email] (not to SPSSX-L), with no body text except the
>command. To leave the list, send the command
>SIGNOFF SPSSX-L
>For a list of commands to manage subscriptions, send the command
>INFO REFCARD
>
>
>