Maximum Rows in SPSS exceeeeeded

[Rajeshms]

Hi,

Its good to know what is the maximum row does spss can handle, so that while working we can constrain our-self in the data set.This is because while restructuring a data, I got the message that,the maximum row exceeded and 80000000 will be displayed.

Thanks all.

--

Regards,

RMS

[Rick Oliver-3]

There is no set limit on the maximum number of rows (cases), and while 80 million is large, it's not unreasonably large. Here's an input program that creates 90 million cases:

input program.
loop var1=1 to 90000000.
end case.
end loop.
end file.
end input program.
execute.

It's possible that you need to increase the value of SET WORKSPACE or SET MXCELLS for the procedure you are running.
 
Rick Oliver
Senior Information Developer
IBM Business Analytics (SPSS)
E-mail: [hidden email]



From:        Rajeshms <[hidden email]>
To:        [hidden email],
Date:        09/19/2013 12:27 AM
Subject:        Maximum Rows in SPSS exceeeeeded
Sent by:        "SPSSX(r) Discussion" <[hidden email]>

---

Hi,

Its good to know what is the maximum row does spss can handle, so that while working we can constrain our-self in the data set.This is because while restructuring a data, I got the message that,the maximum row exceeded and 80000000 will be displayed.

Thanks all.



--
Regards,
RMS

[David Marso]

Perhaps provide a tiny bit of context?
How many rows in the data file?  How many columns?
Exact syntax? Exact error message?
SPSS version? OS version? 32 bit | 64 bit?
etc....

Rajeshms wrote

Hi,

Its good to know what is the maximum row does spss can handle, so that
while working we can constrain our-self in the data set.This is because
while restructuring a data, I got the message that,the maximum row exceeded
and 80000000 will be displayed.

Thanks all.



--
Regards,
RMS

[Richard Ristow]

At 01:24 AM 9/19/2013, Rajeshms wrote:

>Its good to know what is the maximum row does spss can handle, so
>that while working we can constrain our-self in the data set.This is
>because while restructuring a data, I got the message that,the
>maximum row exceeded and 80000000 will be displayed.

As others have noted, the theoretical maximum is very large (2**31-1,
I believe); and the practical maximum, while smaller, is definitely
larger than 80E6.

Be aware that sometimes it is awkward, or even impossible, to display
as large a file in a Data Editor window as SPSS itself can handle.

And as David Marso asked: Could you give us the exact syntax that led
to the error message, the exact text of the message, and the number
of variables and cases in the file?

-Best of luck,
  Richard Ristow

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD

[David Marso]

Just because the data editor can't display it does NOT mean that the operation failed!!!

Richard Ristow wrote

At 01:24 AM 9/19/2013, Rajeshms wrote:

>Its good to know what is the maximum row does spss can handle, so
>that while working we can constrain our-self in the data set.This is
>because while restructuring a data, I got the message that,the
>maximum row exceeded and 80000000 will be displayed.

As others have noted, the theoretical maximum is very large (2**31-1,
I believe); and the practical maximum, while smaller, is definitely
larger than 80E6.

Be aware that sometimes it is awkward, or even impossible, to display
as large a file in a Data Editor window as SPSS itself can handle.

And as David Marso asked: Could you give us the exact syntax that led
to the error message, the exact text of the message, and the number
of variables and cases in the file?

-Best of luck,
  Richard Ristow

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD

[Richard Ristow]

At 01:21 PM 9/20/2013, David Marso wrote:

>Just because the data editor can't display it does NOT mean that the
>operation failed!!!

No, it doesn't. I'm sorry if I wasn't clear about that. There's no
need at all for a dataset to be displayed in the data editor, for
SPSS to use it. For very large datasets that you don't need in the
data editor, specifying WINDOW=HIDDEN on DATASET DECLARE and DATASET
COPY commands (unfortunately not available on DATASET NAME or DATASET
ACTIVATE) should bypass the data editor for the datasets so specified.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD

[Rick Oliver-3]

The "theoretical limit" turns out not to be a limit at all.

Don't try this at home unless you have some time and a reasonably powerful computer. I did it on a 64-bit quad-four processor with 16 GB of memory running the 64-bit version of Statistics:

input program.
loop i=1 to 2**31+100.
end case.
end loop.
end file.
end input program.
execute.

Rick Oliver
Senior Information Developer
IBM Business Analytics (SPSS)
E-mail: [hidden email]



From:        Richard Ristow <[hidden email]>
To:        [hidden email],
Date:        09/20/2013 12:17 PM
Subject:        Re: Maximum Rows in SPSS exceeeeeded
Sent by:        "SPSSX(r) Discussion" <[hidden email]>

---

At 01:24 AM 9/19/2013, Rajeshms wrote:

>Its good to know what is the maximum row does spss can handle, so
>that while working we can constrain our-self in the data set.This is
>because while restructuring a data, I got the message that,the
>maximum row exceeded and 80000000 will be displayed.

As others have noted, the theoretical maximum is very large (2**31-1,
I believe); and the practical maximum, while smaller, is definitely
larger than 80E6.

Be aware that sometimes it is awkward, or even impossible, to display
as large a file in a Data Editor window as SPSS itself can handle.

And as David Marso asked: Could you give us the exact syntax that led
to the error message, the exact text of the message, and the number
of variables and cases in the file?

-Best of luck,
 Richard Ristow

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD