Is there a way to change the litmit of files to be processed in one session?

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Is there a way to change the litmit of files to be processed in one session?

albert_sun
The current limit is 3988. Any way to increase it?
Reply | Threaded
Open this post in threaded view
|

Re: Is there a way to change the litmit of files to be processed in one session?

Jon K Peck
I think Statistics is running out of operating system file handle resources.  Something is apparently keeping the previous file handles assigned as  you go through your loop.  I believe some enhancements were made perhaps after your version of Statistics to release handles more aggressively, so behavior might be better with a later release or a fixpack for your version.


Jon Peck (no "h") aka Kim
Senior Software Engineer, IBM
[hidden email]
phone: 720-342-5621




From:        albert_sun <[hidden email]>
To:        [hidden email],
Date:        04/24/2014 06:34 AM
Subject:        [SPSSX-L] Is there a way to change the litmit of files to be              processed in              one session?
Sent by:        "SPSSX(r) Discussion" <[hidden email]>




The current limit is 3988. Any way to increase it?



--
View this message in context:
http://spssx-discussion.1045642.n5.nabble.com/Is-there-a-way-to-change-the-litmit-of-files-to-be-processed-in-one-session-tp5725647.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD


Reply | Threaded
Open this post in threaded view
|

Re: Is there a way to change the litmit of files to be processed in one session?

David Marso
Administrator
For context see http://spssx-discussion.1045642.n5.nabble.com/Limite-on-MITERATE-td5725602.html
It is evident from my demo code about 3 posts from the end that these enhancements do not apply.

Jon K Peck wrote
I think Statistics is running out of operating system file handle
resources.  Something is apparently keeping the previous file handles
assigned as  you go through your loop.  I believe some enhancements were
made perhaps after your version of Statistics to release handles more
aggressively, so behavior might be better with a later release or a
fixpack for your version.


Jon Peck (no "h") aka Kim
Senior Software Engineer, IBM
[hidden email]
phone: 720-342-5621




From:   albert_sun <[hidden email]>
To:     [hidden email],
Date:   04/24/2014 06:34 AM
Subject:        [SPSSX-L] Is there a way to change the litmit of files to
be              processed in              one session?
Sent by:        "SPSSX(r) Discussion" <[hidden email]>



The current limit is 3988. Any way to increase it?



--
View this message in context:
http://spssx-discussion.1045642.n5.nabble.com/Is-there-a-way-to-change-the-litmit-of-files-to-be-processed-in-one-session-tp5725647.html

Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Please reply to the list and not to my personal email.
Those desiring my consulting or training services please feel free to email me.
---
"Nolite dare sanctum canibus neque mittatis margaritas vestras ante porcos ne forte conculcent eas pedibus suis."
Cum es damnatorum possederunt porcos iens ut salire off sanguinum cliff in abyssum?"
Reply | Threaded
Open this post in threaded view
|

Re: Is there a way to change the limit of files to be processed in one session?

Jon K Peck
Well, this is interesting.  Using 22.0.0.1, I see a crash after 3019 files even on Win7 64-bit with 64 bit Statistics.  The crash alert says the maximum file count is 3999.  I don't know why there would be such a limit, but I have filed a defect on this.


Jon Peck (no "h") aka Kim
Senior Software Engineer, IBM
[hidden email]
phone: 720-342-5621




From:        David Marso <[hidden email]>
To:        [hidden email],
Date:        04/24/2014 07:46 AM
Subject:        Re: [SPSSX-L] Is there a way to change the litmit of files to be              processed              in one session?
Sent by:        "SPSSX(r) Discussion" <[hidden email]>




For context see
http://spssx-discussion.1045642.n5.nabble.com/Limite-on-MITERATE-td5725602.html
It is evident from my demo code about 3 posts from the end that these
enhancements do not apply.


Jon K Peck wrote
> I think Statistics is running out of operating system file handle
> resources.  Something is apparently keeping the previous file handles
> assigned as  you go through your loop.  I believe some enhancements were
> made perhaps after your version of Statistics to release handles more
> aggressively, so behavior might be better with a later release or a
> fixpack for your version.
>
>
> Jon Peck (no "h") aka Kim
> Senior Software Engineer, IBM

> peck@.ibm

> phone: 720-342-5621
>
>
>
>
> From:   albert_sun &lt;

> xiaoxun.sun@

> &gt;
> To:

> SPSSX-L@.uga

> ,
> Date:   04/24/2014 06:34 AM
> Subject:        [SPSSX-L] Is there a way to change the litmit of files to
> be              processed in              one session?
> Sent by:        "SPSSX(r) Discussion" &lt;

> SPSSX-L@.uga

> &gt;
>
>
>
> The current limit is 3988. Any way to increase it?
>
>
>
> --
> View this message in context:
>
http://spssx-discussion.1045642.n5.nabble.com/Is-there-a-way-to-change-the-litmit-of-files-to-be-processed-in-one-session-tp5725647.html
>
> Sent from the SPSSX Discussion mailing list archive at Nabble.com.
>
> =====================
> To manage your subscription to SPSSX-L, send a message to

> LISTSERV@.UGA

>  (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD





-----
Please reply to the list and not to my personal email.
Those desiring my consulting or training services please feel free to email me.
---
"Nolite dare sanctum canibus neque mittatis margaritas vestras ante porcos ne forte conculcent eas pedibus suis."
Cum es damnatorum possederunt porcos iens ut salire off sanguinum cliff in abyssum?"
--
View this message in context:
http://spssx-discussion.1045642.n5.nabble.com/Is-there-a-way-to-change-the-litmit-of-files-to-be-processed-in-one-session-tp5725647p5725650.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD


Reply | Threaded
Open this post in threaded view
|

Re: Is there a way to change the limit of files to be processed in one session?

David Marso
Administrator
With a FRESH session I end up with 3990 files using 22.0.0.2 on Doze 8.1 .
Jon K Peck wrote
Well, this is interesting.  Using 22.0.0.1, I see a crash after 3019 files
even on Win7 64-bit with 64 bit Statistics.  The crash alert says the
maximum file count is 3999.  I don't know why there would be such a limit,
but I have filed a defect on this.


Jon Peck (no "h") aka Kim
Senior Software Engineer, IBM
[hidden email]
phone: 720-342-5621




From:   David Marso <[hidden email]>
To:     [hidden email],
Date:   04/24/2014 07:46 AM
Subject:        Re: [SPSSX-L] Is there a way to change the litmit of files
to be              processed              in one session?
Sent by:        "SPSSX(r) Discussion" <[hidden email]>



For context see
http://spssx-discussion.1045642.n5.nabble.com/Limite-on-MITERATE-td5725602.html

It is evident from my demo code about 3 posts from the end that these
enhancements do not apply.


Jon K Peck wrote
> I think Statistics is running out of operating system file handle
> resources.  Something is apparently keeping the previous file handles
> assigned as  you go through your loop.  I believe some enhancements were
> made perhaps after your version of Statistics to release handles more
> aggressively, so behavior might be better with a later release or a
> fixpack for your version.
>
>
> Jon Peck (no "h") aka Kim
> Senior Software Engineer, IBM

> peck@.ibm

> phone: 720-342-5621
>
>
>
>
> From:   albert_sun <

> xiaoxun.sun@

> >
> To:

> SPSSX-L@.uga

> ,
> Date:   04/24/2014 06:34 AM
> Subject:        [SPSSX-L] Is there a way to change the litmit of files
to
> be              processed in              one session?
> Sent by:        "SPSSX(r) Discussion" <

> SPSSX-L@.uga

> >
>
>
>
> The current limit is 3988. Any way to increase it?
>
>
>
> --
> View this message in context:
>
http://spssx-discussion.1045642.n5.nabble.com/Is-there-a-way-to-change-the-litmit-of-files-to-be-processed-in-one-session-tp5725647.html

>
> Sent from the SPSSX Discussion mailing list archive at Nabble.com.
>
> =====================
> To manage your subscription to SPSSX-L, send a message to

> LISTSERV@.UGA

>  (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD





-----
Please reply to the list and not to my personal email.
Those desiring my consulting or training services please feel free to
email me.
---
"Nolite dare sanctum canibus neque mittatis margaritas vestras ante porcos
ne forte conculcent eas pedibus suis."
Cum es damnatorum possederunt porcos iens ut salire off sanguinum cliff in
abyssum?"
--
View this message in context:
http://spssx-discussion.1045642.n5.nabble.com/Is-there-a-way-to-change-the-litmit-of-files-to-be-processed-in-one-session-tp5725647p5725650.html

Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Please reply to the list and not to my personal email.
Those desiring my consulting or training services please feel free to email me.
---
"Nolite dare sanctum canibus neque mittatis margaritas vestras ante porcos ne forte conculcent eas pedibus suis."
Cum es damnatorum possederunt porcos iens ut salire off sanguinum cliff in abyssum?"