Error sorting a big data set

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Error sorting a big data set

Vicent Giner-Bosch
I get this error when trying to sort a big data set:

>Error # 5817. Command name: SORT CASES BY

>The SPSS file sort has failed. The file remains unsorted. The specific

>problem is printed below.



>Error # 5822. Command name: SORT CASES BY

>I/O error writing to the sort scratch file.



By the way, "a big data set" is, in this case, a data set with 10,451,034
rows and 234 variables. I want to sort it by two variables: one of them is
numeric, and the other is a date.

Is the size the reason for the error? Any way to solve this?




--
Vicent

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Reply | Threaded
Open this post in threaded view
|

Re: Error sorting a big data set

Raynald Levesque-2
Hi

I regularly sort larger files without any problems.

My guess is that your ran out of disk space. For a sort, SPSS needs disk
space at least 3 times the size of the original file.

--
Raynald Levesque
www.spsstools.net


On Jan 10, 2008 6:55 PM, Vicent Giner Bosch <[hidden email]> wrote:

> I get this error when trying to sort a big data set:
>
> >Error # 5817. Command name: SORT CASES BY
>
> >The SPSS file sort has failed. The file remains unsorted. The specific
>
> >problem is printed below.
>
>
>
> >Error # 5822. Command name: SORT CASES BY
>
> >I/O error writing to the sort scratch file.
>
>
>
> By the way, "a big data set" is, in this case, a data set with 10,451,034
> rows and 234 variables. I want to sort it by two variables: one of them is
> numeric, and the other is a date.
>
> Is the size the reason for the error? Any way to solve this?
>
>
>
>
> --
> Vicent
>
> =====================
> To manage your subscription to SPSSX-L, send a message to
> [hidden email] (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD
>

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Reply | Threaded
Open this post in threaded view
|

Re: Error sorting a big data set

Vicent Giner-Bosch
Yes, that was the problem, I think.

I changed the path for the temporary file folder, to another disk where I
have more free space.

Thank you everyone for your answers!

--
Vicent Giner



  _____

De: Raynald Levesque [mailto:[hidden email]]
Enviado el: viernes, 11 de enero de 2008 2:17
Para: Vicent Giner Bosch
CC: [hidden email]
Asunto: Re: Error sorting a big data set


Hi

I regularly sort larger files without any problems.

My guess is that your ran out of disk space. For a sort, SPSS needs disk
space at least 3 times the size of the original file.

--
Raynald Levesque
www.spsstools.net



On Jan 10, 2008 6:55 PM, Vicent Giner Bosch <[hidden email]> wrote:


I get this error when trying to sort a big data set:

>Error # 5817. Command name: SORT CASES BY

>The SPSS file sort has failed. The file remains unsorted. The specific

>problem is printed below.



>Error # 5822. Command name: SORT CASES BY

>I/O error writing to the sort scratch file.



By the way, "a big data set" is, in this case, a data set with 10,451,034
rows and 234 variables. I want to sort it by two variables: one of them is
numeric, and the other is a date.

Is the size the reason for the error? Any way to solve this?




--
Vicent

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD