Maximum Number of Cases in SPSS 14.0

[Jim Moffitt]

Can SPSS 14.0 handle a data file consisiting of 542,000 cases and 12
variables?
 
Is it advisable to split the data set into multiple files?
 
Does anyone have any advice on the best way to import such a data set
into SPSS from Access 2000?
 
Thanks for your help.

[Melissa Ives]

Yes, the number of cases is less important than the number of variables.
So far, I have MANY more variables (>3400), but far fewer cases (about
31,000) with no problem.  That file is 218 Mg.

In terms of importing from Access to SPSS, there is a database wizard
you can use with dbase files, Excel or Access files.  Go to File-->Open
Database-->New Query and go from there.  It seemed fairly
straightforward, but I haven't used it.

Melissa

-----Original Message-----
From: SPSSX(r) Discussion [mailto:[hidden email]] On Behalf Of
Jim Moffitt
Sent: Friday, January 05, 2007 3:54 PM
To: [hidden email]
Subject: [SPSSX-L] Maximum Number of Cases in SPSS 14.0

Can SPSS 14.0 handle a data file consisiting of 542,000 cases and 12
variables?

Is it advisable to split the data set into multiple files?

Does anyone have any advice on the best way to import such a data set
into SPSS from Access 2000?

Thanks for your help.



PRIVILEGED AND CONFIDENTIAL INFORMATION
This transmittal and any attachments may contain PRIVILEGED AND
CONFIDENTIAL information and is intended only for the use of the
addressee. If you are not the designated recipient, or an employee
or agent authorized to deliver such transmittals to the designated
recipient, you are hereby notified that any dissemination,
copying or publication of this transmittal is strictly prohibited. If
you have received this transmittal in error, please notify us
immediately by replying to the sender and delete this copy from your
system. You may also call us at [phone] for assistance.

[Richard Ristow]

At 04:53 PM 1/5/2007, Jim Moffitt wrote:

>Can SPSS 14.0 handle a data file consisiting of 542,000 cases and 12
>variables?

Easily, on any machine that's at all recent. Probably, any one that can
run Windows XP comfortably. See just-posted "Re: Upper limit on number
of variables in SPSS 14?"

>Is it advisable to split the data set into multiple files?

Only if that's useful for some other reason, such as that there are
subsets of the data you frequently use for analysis.

>Does anyone have any advice on the best way to import such a data set
>into SPSS from Access 2000?

I'll let somebody else have this one...

[Boyd, Christopher]

>Does anyone have any advice on the best way to import such a data set
>into SPSS from Access 2000?

For the MS Access import, look under 'File' select open data-base and it
should be self apparent from then on -- unless this was a joke post to
see if someone would respond.......



-----Original Message-----
From: SPSSX(r) Discussion [mailto:[hidden email]] On Behalf Of
Richard Ristow
Sent: Friday, January 05, 2007 5:03 PM
To: [hidden email]
Subject: Re: Maximum Number of Cases in SPSS 14.0

At 04:53 PM 1/5/2007, Jim Moffitt wrote:

>Can SPSS 14.0 handle a data file consisiting of 542,000 cases and 12
>variables?

Easily, on any machine that's at all recent. Probably, any one that can
run Windows XP comfortably. See just-posted "Re: Upper limit on number
of variables in SPSS 14?"

>Is it advisable to split the data set into multiple files?

Only if that's useful for some other reason, such as that there are
subsets of the data you frequently use for analysis.

>Does anyone have any advice on the best way to import such a data set
>into SPSS from Access 2000?

I'll let somebody else have this one...

**********************************************************************
Sent from the New York City Office of the Comptroller. This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to whom they are addressed. This footnote also confirms that this email message has been swept for the presence of computer viruses.
**********************************************************************

[Hector Maletta]

        How about 10 million cases with about 400 variables? This is about
the size of the last file I've been working with in my run-of-the-mill
laptop, not an extremely large one by my standards, really.
        Even if there actually is a theoretical upper limit to the size of
an SPSS file, for all practical purposes such limit is not operative. It is
your machine, its hard disk mainly, which sets the actual limit. And your
RAM and CPU determine the time required when huge amounts of data are to be
read and processed.

        Hector

        -----Mensaje original-----
De: SPSSX(r) Discussion [mailto:[hidden email]] En nombre de
Richard Ristow
Enviado el: 05 January 2007 19:03
Para: [hidden email]
Asunto: Re: Maximum Number of Cases in SPSS 14.0

        At 04:53 PM 1/5/2007, Jim Moffitt wrote:

        >Can SPSS 14.0 handle a data file consisiting of 542,000 cases and
12
        >variables?

        Easily, on any machine that's at all recent. Probably, any one that
can
        run Windows XP comfortably. See just-posted "Re: Upper limit on
number
        of variables in SPSS 14?"

        >Is it advisable to split the data set into multiple files?

        Only if that's useful for some other reason, such as that there are
        subsets of the data you frequently use for analysis.

        >Does anyone have any advice on the best way to import such a data
set
        >into SPSS from Access 2000?

        I'll let somebody else have this one...

[Ramzan Afzal]

Yes - it is possible as far as I know to the best of my knowledge. I have been recently working on data in ACCESS database with more than 500000 rows and more than 10 columns. SPSS data wizard imports successfully data from ACCESS but sometimes it crashes during the process of import - so I have to redo the process.

Better RAM and CPU speed will also be a great support.

Regards

Ramzan

 

 

---

From:  Jim Moffitt <[hidden email]>
Reply-To:  [hidden email]
To:  [hidden email]
Subject:  Maximum Number of Cases in SPSS 14.0
Date:  Fri, 5 Jan 2007 15:53:41 -0600
>Can SPSS 14.0 handle a data file consisiting of 542,000 cases and 12
>variables?
>
>Is it advisable to split the data set into multiple files?
>
>Does anyone have any advice on the best way to import such a data set
>into SPSS from Access 2000?
>
>Thanks for your help.

---

FREE pop-up blocking with the new MSN Toolbar MSN Toolbar Get it now!

[Adnan Siddiqui]

sorry it is a little late to get into this discussion.

 well a few days back i search for the question, the number of variables and
cases SPSS can work with, and i found the answer at a web-link, thats
tells,  we can work with 2.15 billion variable and 2.15 billion cases in
SPSS, but it is recommended, not to load, huge number of variable at the
same time. but load variable of interest at a time. But i literaly never
work with more than 100 variables.

In case of importing data from Access, what i do is, first save Access data
file for MsExcel and then open that file in SPSS (Access=>Excel=>SPSS). But,
i never work with huge importing from Access to SPSS via Excel.

Thanks, and please correct me if anyone have more latest or more correct
information on this.

Adnan Siddiqui
Research Associate
AKU-IED
Pakistan


On 06/01/07, Jim Moffitt <[hidden email]> wrote:

>
> Can SPSS 14.0 handle a data file consisiting of 542,000 cases and 12
> variables?
>
> Is it advisable to split the data set into multiple files?
>
> Does anyone have any advice on the best way to import such a data set
> into SPSS from Access 2000?
>
> Thanks for your help.
>

[Hector Maletta]

Adnan,
it is not necessary to pass through the Excel phase. Moreover, Excel is limited to about 65000 cases and 256 variables, whereas Access (and SPSS) can work with millions of cases and many more variables.

On the other hand, this possibility does not mean that you MUST work with all cases and all variables all the time. For some really HUGE files you may prefer to select subsets of variables, and/or perhaps subsets of cases, and work only with them in order to save on processing time. But HUGE typically means files of several Gigabytes in size. With a standard PC (typically Pentium IV or Centrino), and a file of less than 100 Megabytes, you would not notice the difference. Even with files larger than that, going into the trouble of selecting variables and keeping track of partial files is often not worthwhile. Thus is at least my experience. I have found it worth my time only when I work with files comprising millions of cases and hundreds of variables, with sizes measured in Gb.

Hector

----- Mensaje original -----
De: Adnan Siddiqui <[hidden email]>
Fecha: Martes, Enero 9, 2007 8:41 am
Asunto: Re: Maximum Number of Cases in SPSS 14.0

> sorry it is a little late to get into this discussion.
>
> well a few days back i search for the question, the number of
> variables and
> cases SPSS can work with, and i found the answer at a web-link, thats
> tells,  we can work with 2.15 billion variable and 2.15 billion
> cases in
> SPSS, but it is recommended, not to load, huge number of variable
> at the
> same time. but load variable of interest at a time. But i literaly
> neverwork with more than 100 variables.
>
> In case of importing data from Access, what i do is, first save
> Access data
> file for MsExcel and then open that file in SPSS
> (Access=>Excel=>SPSS). But,
> i never work with huge importing from Access to SPSS via Excel.
>
> Thanks, and please correct me if anyone have more latest or more
> correctinformation on this.
>
> Adnan Siddiqui
> Research Associate
> AKU-IED
> Pakistan
>
>
> On 06/01/07, Jim Moffitt <[hidden email]> wrote:
> >
> > Can SPSS 14.0 handle a data file consisiting of 542,000 cases
> and 12
> > variables?
> >
> > Is it advisable to split the data set into multiple files?
> >
> > Does anyone have any advice on the best way to import such a
> data set
> > into SPSS from Access 2000?
> >
> > Thanks for your help.
> >
>