Insufficent Memory Error with Linear Mixed Models
Locked
 
|
Hello,
I am trying to run the following analysis on a data set with 1062 cases and 139 variables (not all of which are included in the analysis). MIXED Duration BY A B C /CRITERIA=CIN(95) MXITER(100) MXSTEP(10) SCORING(1) SINGULAR(0.000000000001) HCONVERGE(0, ABSOLUTE) LCONVERGE(0, ABSOLUTE) PCONVERGE(0.000001, ABSOLUTE) /FIXED=A B C A*B A*C B*C | SSTYPE(3) /METHOD=ML /PRINT=SOLUTION TESTCOV /RANDOM=INTERCEPT | SUBJECT(ID) COVTYPE(VC) /REPEATED=D*E*B | SUBJECT(ID) COVTYPE(UN) /EMMEANS=TABLES(A) COMPARE ADJ(BONFERRONI) /EMMEANS=TABLES(B) COMPARE ADJ(BONFERRONI) /EMMEANS=TABLES(C) COMPARE ADJ(BONFERRONI) /EMMEANS=TABLES(A*B) compare (A) /EMMEANS=TABLES(A*B) compare (B) /EMMEANS=TABLES(A*C) compare (A) /EMMEANS=TABLES(A*C) compare (C) /EMMEANS=TABLES(B*C) compare (B) /EMMEANS=TABLES(B*C) compare (C). A is a nominal variable with 3 levels, B is a nominal variable with 2 levels, C is a nominal variable with 2 levels, D is a nominal variable with 10 levels, and E is a nominal variable with 2 levels; Duration is a scale variable. Every time I run the analysis I get an error message saying "Insufficient memory to estimate the model parameters". I have tried various things to try and work around this error, including running it on a computer with two quad core processors and 24GB RAM, removing the random intercept and using PRESERVE. SET WORKSPACE=200000. *** run your thing ***. RESTORE. Are there any other suggestions as to how I could make this run? Thank you, Kristine |
Re: Insufficent Memory Error with Linear Mixed Models
|
|
Hi!
--139 variables? Have you tried running the analysis on a dataset that ONLY uses the variables you need?
--I'd certainly not use SET WORKSPACE (I have tried it before and it doesn't speed things up but causes errors).
--You can run the analysis in the Production Facility to decrease overhead.
--I don't know the analysis you're doing and whether it accepts string variables (for factors, nomimal variables), but it might be a good idea to use e.g. AUTORECODE to convert string vars to numerical "surrogate variables" and use those instead.
Regards,
Albert-Jan ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ All right, but apart from the sanitation, the medicine, education, wine, public order, irrigation, roads, a fresh water system, and public health, what have the Romans ever done for us? ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
Automatic reply: Insufficent Memory Error with Linear Mixed Models
|
|
I will be out of the office from Friday August 17 through Sunday August 25th. If you have questions about the ADE system, please call Craig
at 1-800-334-1918. Any other questions, please contact Dan Hall, at 331-0415. Thanks! |
Automatic reply: Insufficent Memory Error with Linear Mixed Models
|
|
In reply to this post by Albert-Jan Roskam
I am currently out of the office and will return your message on Monday, August 20th. |
Re: Insufficent Memory Error with Linear Mixed Models
Administrator
|
In reply to this post by Kristine
"I have tried various things to try and work around this error, including running it on a computer with two quad core processors and 24GB RAM" ...
Unless the SPSS in the 24G box is 64 bit with a 64 bit OS it won't make any difference if you have 4G or 200G memory! What happens if you run it with a subset of the data to see where it breaks? Albert Jan in part stated "--I'd certainly not use SET WORKSPACE (I have tried it before and it doesn't speed things up but causes errors)." I do not concur with this statement in the least. After all it is not about speed it is about cramming crap into memory. I know of no errors caused by SET WORKSPACE. Perhaps he would be willing to elaborate? In fact why not try SET WORKSPACE =4000000 and see if the analysis runs (be sure to set it back to normal afterwards. OTOH, SET WORKSPACE may have no effect on MIXED so it is then a matter of 32 bit vs 64 bit OS and SW and the amount of actual RAM (and likely disk space if it has to swap). It may be a matter of SPSS versions as well. I know that things have changed over released WRT the way memory is managed and the degree to which SET WORKSPACE operates with various procedures.
Please reply to the list and not to my personal email.
Those desiring my consulting or training services please feel free to email me. --- "Nolite dare sanctum canibus neque mittatis margaritas vestras ante porcos ne forte conculcent eas pedibus suis." Cum es damnatorum possederunt porcos iens ut salire off sanguinum cliff in abyssum?" |
|
|
The residual matrix R very likely needs to be simplified. Tell us what you are trying to accomplish with the repeated statement, random statement, and with the model overall. More details please...
Ryan Sent from my iPhone On Aug 17, 2012, at 10:58 AM, David Marso <[hidden email]> wrote: > "I have tried various things to try and work around this error, including > running it on a computer with two quad core processors and 24GB RAM" ... > Unless the SPSS in the 24G box is 64 bit with a 64 bit OS it *won't* make > any difference if you have 4G or 200G memory! > What happens if you run it with a subset of the data to see where it breaks? > Albert Jan in part stated "--I'd certainly not use SET WORKSPACE (I have > tried it before and it doesn't speed things up but causes errors)." > I *do not* concur with this statement in the least. After all it is not > about speed it is about cramming crap into memory. I know of no errors > caused by SET WORKSPACE. Perhaps he would be willing to elaborate? > In fact why not try SET WORKSPACE =4000000 and see if the analysis runs (be > sure to set it back to normal afterwards. > OTOH, SET WORKSPACE may have no effect on MIXED so it is then a matter of 32 > bit vs 64 bit OS and SW and the amount of actual RAM (and likely disk space > if it has to swap). It may be a matter of SPSS versions as well. I know > that things have changed over released WRT the way memory is managed and the > degree to which SET WORKSPACE operates with various procedures. > > > Kristine wrote >> >> Hello, >> >> I am trying to run the following analysis on a data set with 1062 cases >> and 139 variables (not all of which are included in the analysis). >> >> MIXED Duration BY A B C >> /CRITERIA=CIN(95) MXITER(100) MXSTEP(10) SCORING(1) >> SINGULAR(0.000000000001) HCONVERGE(0, >> ABSOLUTE) LCONVERGE(0, ABSOLUTE) PCONVERGE(0.000001, ABSOLUTE) >> /FIXED=A B C A*B A*C B*C | SSTYPE(3) >> /METHOD=ML >> /PRINT=SOLUTION TESTCOV >> /RANDOM=INTERCEPT | SUBJECT(ID) COVTYPE(VC) >> /REPEATED=D*E*B | SUBJECT(ID) COVTYPE(UN) >> /EMMEANS=TABLES(A) COMPARE ADJ(BONFERRONI) >> /EMMEANS=TABLES(B) COMPARE ADJ(BONFERRONI) >> /EMMEANS=TABLES(C) COMPARE ADJ(BONFERRONI) >> /EMMEANS=TABLES(A*B) compare (A) >> /EMMEANS=TABLES(A*B) compare (B) >> /EMMEANS=TABLES(A*C) compare (A) >> /EMMEANS=TABLES(A*C) compare (C) >> /EMMEANS=TABLES(B*C) compare (B) >> /EMMEANS=TABLES(B*C) compare (C). >> >> A is a nominal variable with 3 levels, B is a nominal variable with 2 >> levels, C is a nominal variable with 2 levels, D is a nominal variable >> with 10 levels, and E is a nominal variable with 2 levels; Duration is a >> scale variable. >> >> Every time I run the analysis I get an error message saying "Insufficient >> memory to estimate the model parameters". I have tried various things to >> try and work around this error, including running it on a computer with >> two quad core processors and 24GB RAM, removing the random intercept and >> using >> >> PRESERVE. >> SET WORKSPACE=200000. >> *** run your thing ***. >> RESTORE. >> >> Are there any other suggestions as to how I could make this run? >> >> Thank you, >> Kristine >> > > > > > -- > View this message in context: http://spssx-discussion.1045642.n5.nabble.com/Insufficent-Memory-Error-with-Linear-Mixed-Models-tp5714746p5714757.html > Sent from the SPSSX Discussion mailing list archive at Nabble.com. > > ===================== > To manage your subscription to SPSSX-L, send a message to > [hidden email] (not to SPSSX-L), with no body text except the > command. To leave the list, send the command > SIGNOFF SPSSX-L > For a list of commands to manage subscriptions, send the command > INFO REFCARD ===================== To manage your subscription to SPSSX-L, send a message to [hidden email] (not to SPSSX-L), with no body text except the command. To leave the list, send the command SIGNOFF SPSSX-L For a list of commands to manage subscriptions, send the command INFO REFCARD |
Re: Insufficent Memory Error with Linear Mixed Models
|
|
In reply to this post by David Marso
Hi David,
As promised off-list, I tried to reproduce the memory allocation error that I've seen in the past when using SET WORKSPACE. I am not able to reproduce that error. Maybe it's because my test syntax is too synthetic, or maybe I should run it more often (ie, the errors are rare and unpredictable; I ran the syntax 50 times). I modified an existing syntax (see below) for the tests. On my computer, I saw no improvements in processing speed for set workspace = !MAX_WORKSPACE and set workspace = !MIN_WORKSPACE. Maybe things can go wrong when there are more procedures/data passes involved --I'm just speculating.
Anyway, I would not want my code to be 1 % faster at the cost of decreased reliability.
Regards,
Albert-Jan ********************************************.
preserve.
set printback = off.
show workspace.
define !MAX_WORKSPACE () 2097151 !enddefine.
define !MIN_WORKSPACE () 6148 !enddefine.
set workspace = !MAX_WORKSPACE.
* set workspace = !MIN_WORKSPACE.
* set workspace = 1048576.
host command = ['echo %time%'].
set rng = mt mtindex = 54321.
input program.
+loop #case = 1 to 10**1.
+do repeat #v = v1 to v1000.
+compute #v = uniform(1000).
+end repeat.
+end case.
+end loop.
+end file.
end input program.
compute x0 = uniform(1000).
compute x1 = uniform(1000).
compute x2 = uniform(1000).
compute x3 = uniform(1000).
compute x4 = uniform(1000).
compute x5 = uniform(1000).
compute x6 = uniform(1000).
compute x7 = uniform(1000).
compute x8 = uniform(1000).
compute x9 = uniform(1000).
compute x10 = uniform(1000).
compute x11 = uniform(1000).
compute x12 = uniform(1000).
compute x13 = uniform(1000).
compute x14 = uniform(1000).
compute x15 = uniform(1000).
compute x16 = uniform(1000).
compute x17 = uniform(1000).
compute x18 = uniform(1000).
compute x19 = uniform(1000).
compute x20 = uniform(1000).
compute x21 = uniform(1000).
compute x22 = uniform(1000).
compute x23 = uniform(1000).
compute x24 = uniform(1000).
compute x25 = uniform(1000).
compute x26 = uniform(1000).
compute x27 = uniform(1000).
compute x28 = uniform(1000).
compute x29 = uniform(1000).
compute x30 = uniform(1000).
compute x31 = uniform(1000).
compute x32 = uniform(1000).
compute x33 = uniform(1000).
compute x34 = uniform(1000).
compute x35 = uniform(1000).
compute x36 = uniform(1000).
compute x37 = uniform(1000).
compute x38 = uniform(1000).
compute x39 = uniform(1000).
compute x40 = uniform(1000).
compute x41 = uniform(1000).
compute x42 = uniform(1000).
compute x43 = uniform(1000).
compute x44 = uniform(1000).
compute x45 = uniform(1000).
compute x46 = uniform(1000).
compute x47 = uniform(1000).
compute x48 = uniform(1000).
compute x49 = uniform(1000).
compute x50 = uniform(1000).
compute x51 = uniform(1000).
compute x52 = uniform(1000).
compute x53 = uniform(1000).
compute x54 = uniform(1000).
compute x55 = uniform(1000).
compute x56 = uniform(1000).
compute x57 = uniform(1000).
compute x58 = uniform(1000).
compute x59 = uniform(1000).
compute x60 = uniform(1000).
compute x61 = uniform(1000).
compute x62 = uniform(1000).
compute x63 = uniform(1000).
compute x64 = uniform(1000).
compute x65 = uniform(1000).
compute x66 = uniform(1000).
compute x67 = uniform(1000).
compute x68 = uniform(1000).
compute x69 = uniform(1000).
compute x70 = uniform(1000).
compute x71 = uniform(1000).
compute x72 = uniform(1000).
compute x73 = uniform(1000).
compute x74 = uniform(1000).
compute x75 = uniform(1000).
compute x76 = uniform(1000).
compute x77 = uniform(1000).
compute x78 = uniform(1000).
compute x79 = uniform(1000).
compute x80 = uniform(1000).
compute x81 = uniform(1000).
compute x82 = uniform(1000).
compute x83 = uniform(1000).
compute x84 = uniform(1000).
compute x85 = uniform(1000).
compute x86 = uniform(1000).
compute x87 = uniform(1000).
compute x88 = uniform(1000).
compute x89 = uniform(1000).
compute x90 = uniform(1000).
compute x91 = uniform(1000).
compute x92 = uniform(1000).
compute x93 = uniform(1000).
compute x94 = uniform(1000).
compute x95 = uniform(1000).
compute x96 = uniform(1000).
compute x97 = uniform(1000).
compute x98 = uniform(1000).
compute x99 = uniform(1000).
compute x100 = uniform(1000).
compute x101 = uniform(1000).
compute x102 = uniform(1000).
compute x103 = uniform(1000).
compute x104 = uniform(1000).
compute x105 = uniform(1000).
compute x106 = uniform(1000).
compute x107 = uniform(1000).
compute x108 = uniform(1000).
compute x109 = uniform(1000).
compute x110 = uniform(1000).
compute x111 = uniform(1000).
compute x112 = uniform(1000).
compute x113 = uniform(1000).
compute x114 = uniform(1000).
compute x115 = uniform(1000).
compute x116 = uniform(1000).
compute x117 = uniform(1000).
compute x118 = uniform(1000).
compute x119 = uniform(1000).
compute x120 = uniform(1000).
compute x121 = uniform(1000).
compute x122 = uniform(1000).
compute x123 = uniform(1000).
compute x124 = uniform(1000).
compute x125 = uniform(1000).
compute x126 = uniform(1000).
compute x127 = uniform(1000).
compute x128 = uniform(1000).
compute x129 = uniform(1000).
compute x130 = uniform(1000).
compute x131 = uniform(1000).
compute x132 = uniform(1000).
compute x133 = uniform(1000).
compute x134 = uniform(1000).
compute x135 = uniform(1000).
compute x136 = uniform(1000).
compute x137 = uniform(1000).
compute x138 = uniform(1000).
compute x139 = uniform(1000).
compute x140 = uniform(1000).
compute x141 = uniform(1000).
compute x142 = uniform(1000).
compute x143 = uniform(1000).
compute x144 = uniform(1000).
compute x145 = uniform(1000).
compute x146 = uniform(1000).
compute x147 = uniform(1000).
compute x148 = uniform(1000).
compute x149 = uniform(1000).
compute x150 = uniform(1000).
compute x151 = uniform(1000).
compute x152 = uniform(1000).
compute x153 = uniform(1000).
compute x154 = uniform(1000).
compute x155 = uniform(1000).
compute x156 = uniform(1000).
compute x157 = uniform(1000).
compute x158 = uniform(1000).
compute x159 = uniform(1000).
compute x160 = uniform(1000).
compute x161 = uniform(1000).
compute x162 = uniform(1000).
compute x163 = uniform(1000).
compute x164 = uniform(1000).
compute x165 = uniform(1000).
compute x166 = uniform(1000).
compute x167 = uniform(1000).
compute x168 = uniform(1000).
compute x169 = uniform(1000).
compute x170 = uniform(1000).
compute x171 = uniform(1000).
compute x172 = uniform(1000).
compute x173 = uniform(1000).
compute x174 = uniform(1000).
compute x175 = uniform(1000).
compute x176 = uniform(1000).
compute x177 = uniform(1000).
compute x178 = uniform(1000).
compute x179 = uniform(1000).
compute x180 = uniform(1000).
compute x181 = uniform(1000).
compute x182 = uniform(1000).
compute x183 = uniform(1000).
compute x184 = uniform(1000).
compute x185 = uniform(1000).
compute x186 = uniform(1000).
compute x187 = uniform(1000).
compute x188 = uniform(1000).
compute x189 = uniform(1000).
compute x190 = uniform(1000).
compute x191 = uniform(1000).
compute x192 = uniform(1000).
compute x193 = uniform(1000).
compute x194 = uniform(1000).
compute x195 = uniform(1000).
compute x196 = uniform(1000).
compute x197 = uniform(1000).
compute x198 = uniform(1000).
compute x199 = uniform(1000).
compute x200 = uniform(1000).
compute x201 = uniform(1000).
compute x202 = uniform(1000).
compute x203 = uniform(1000).
compute x204 = uniform(1000).
compute x205 = uniform(1000).
compute x206 = uniform(1000).
compute x207 = uniform(1000).
compute x208 = uniform(1000).
compute x209 = uniform(1000).
compute x210 = uniform(1000).
compute x211 = uniform(1000).
compute x212 = uniform(1000).
compute x213 = uniform(1000).
compute x214 = uniform(1000).
compute x215 = uniform(1000).
compute x216 = uniform(1000).
compute x217 = uniform(1000).
compute x218 = uniform(1000).
compute x219 = uniform(1000).
compute x220 = uniform(1000).
compute x221 = uniform(1000).
compute x222 = uniform(1000).
compute x223 = uniform(1000).
compute x224 = uniform(1000).
compute x225 = uniform(1000).
compute x226 = uniform(1000).
compute x227 = uniform(1000).
compute x228 = uniform(1000).
compute x229 = uniform(1000).
compute x230 = uniform(1000).
compute x231 = uniform(1000).
compute x232 = uniform(1000).
compute x233 = uniform(1000).
compute x234 = uniform(1000).
compute x235 = uniform(1000).
compute x236 = uniform(1000).
compute x237 = uniform(1000).
compute x238 = uniform(1000).
compute x239 = uniform(1000).
compute x240 = uniform(1000).
compute x241 = uniform(1000).
compute x242 = uniform(1000).
compute x243 = uniform(1000).
compute x244 = uniform(1000).
compute x245 = uniform(1000).
compute x246 = uniform(1000).
compute x247 = uniform(1000).
compute x248 = uniform(1000).
compute x249 = uniform(1000).
compute x250 = uniform(1000).
compute x251 = uniform(1000).
compute x252 = uniform(1000).
compute x253 = uniform(1000).
compute x254 = uniform(1000).
compute x255 = uniform(1000).
compute x256 = uniform(1000).
compute x257 = uniform(1000).
compute x258 = uniform(1000).
compute x259 = uniform(1000).
compute x260 = uniform(1000).
compute x261 = uniform(1000).
compute x262 = uniform(1000).
compute x263 = uniform(1000).
compute x264 = uniform(1000).
compute x265 = uniform(1000).
compute x266 = uniform(1000).
compute x267 = uniform(1000).
compute x268 = uniform(1000).
compute x269 = uniform(1000).
compute x270 = uniform(1000).
compute x271 = uniform(1000).
compute x272 = uniform(1000).
compute x273 = uniform(1000).
compute x274 = uniform(1000).
compute x275 = uniform(1000).
compute x276 = uniform(1000).
compute x277 = uniform(1000).
compute x278 = uniform(1000).
compute x279 = uniform(1000).
compute x280 = uniform(1000).
compute x281 = uniform(1000).
compute x282 = uniform(1000).
compute x283 = uniform(1000).
compute x284 = uniform(1000).
compute x285 = uniform(1000).
compute x286 = uniform(1000).
compute x287 = uniform(1000).
compute x288 = uniform(1000).
compute x289 = uniform(1000).
compute x290 = uniform(1000).
compute x291 = uniform(1000).
compute x292 = uniform(1000).
compute x293 = uniform(1000).
compute x294 = uniform(1000).
compute x295 = uniform(1000).
compute x296 = uniform(1000).
compute x297 = uniform(1000).
compute x298 = uniform(1000).
compute x299 = uniform(1000).
compute x300 = uniform(1000).
compute x301 = uniform(1000).
compute x302 = uniform(1000).
compute x303 = uniform(1000).
compute x304 = uniform(1000).
compute x305 = uniform(1000).
compute x306 = uniform(1000).
compute x307 = uniform(1000).
compute x308 = uniform(1000).
compute x309 = uniform(1000).
compute x310 = uniform(1000).
compute x311 = uniform(1000).
compute x312 = uniform(1000).
compute x313 = uniform(1000).
compute x314 = uniform(1000).
compute x315 = uniform(1000).
compute x316 = uniform(1000).
compute x317 = uniform(1000).
compute x318 = uniform(1000).
compute x319 = uniform(1000).
compute x320 = uniform(1000).
compute x321 = uniform(1000).
compute x322 = uniform(1000).
compute x323 = uniform(1000).
compute x324 = uniform(1000).
compute x325 = uniform(1000).
compute x326 = uniform(1000).
compute x327 = uniform(1000).
compute x328 = uniform(1000).
compute x329 = uniform(1000).
compute x330 = uniform(1000).
compute x331 = uniform(1000).
compute x332 = uniform(1000).
compute x333 = uniform(1000).
compute x334 = uniform(1000).
compute x335 = uniform(1000).
compute x336 = uniform(1000).
compute x337 = uniform(1000).
compute x338 = uniform(1000).
compute x339 = uniform(1000).
compute x340 = uniform(1000).
compute x341 = uniform(1000).
compute x342 = uniform(1000).
compute x343 = uniform(1000).
compute x344 = uniform(1000).
compute x345 = uniform(1000).
compute x346 = uniform(1000).
compute x347 = uniform(1000).
compute x348 = uniform(1000).
compute x349 = uniform(1000).
compute x350 = uniform(1000).
compute x351 = uniform(1000).
compute x352 = uniform(1000).
compute x353 = uniform(1000).
compute x354 = uniform(1000).
compute x355 = uniform(1000).
compute x356 = uniform(1000).
compute x357 = uniform(1000).
compute x358 = uniform(1000).
compute x359 = uniform(1000).
compute x360 = uniform(1000).
compute x361 = uniform(1000).
compute x362 = uniform(1000).
compute x363 = uniform(1000).
compute x364 = uniform(1000).
compute x365 = uniform(1000).
compute x366 = uniform(1000).
compute x367 = uniform(1000).
compute x368 = uniform(1000).
compute x369 = uniform(1000).
compute x370 = uniform(1000).
compute x371 = uniform(1000).
compute x372 = uniform(1000).
compute x373 = uniform(1000).
compute x374 = uniform(1000).
compute x375 = uniform(1000).
compute x376 = uniform(1000).
compute x377 = uniform(1000).
compute x378 = uniform(1000).
compute x379 = uniform(1000).
compute x380 = uniform(1000).
compute x381 = uniform(1000).
compute x382 = uniform(1000).
compute x383 = uniform(1000).
compute x384 = uniform(1000).
compute x385 = uniform(1000).
compute x386 = uniform(1000).
compute x387 = uniform(1000).
compute x388 = uniform(1000).
compute x389 = uniform(1000).
compute x390 = uniform(1000).
compute x391 = uniform(1000).
compute x392 = uniform(1000).
compute x393 = uniform(1000).
compute x394 = uniform(1000).
compute x395 = uniform(1000).
compute x396 = uniform(1000).
compute x397 = uniform(1000).
compute x398 = uniform(1000).
compute x399 = uniform(1000).
compute x400 = uniform(1000).
compute x401 = uniform(1000).
compute x402 = uniform(1000).
compute x403 = uniform(1000).
compute x404 = uniform(1000).
compute x405 = uniform(1000).
compute x406 = uniform(1000).
compute x407 = uniform(1000).
compute x408 = uniform(1000).
compute x409 = uniform(1000).
compute x410 = uniform(1000).
compute x411 = uniform(1000).
compute x412 = uniform(1000).
compute x413 = uniform(1000).
compute x414 = uniform(1000).
compute x415 = uniform(1000).
compute x416 = uniform(1000).
compute x417 = uniform(1000).
compute x418 = uniform(1000).
compute x419 = uniform(1000).
compute x420 = uniform(1000).
compute x421 = uniform(1000).
compute x422 = uniform(1000).
compute x423 = uniform(1000).
compute x424 = uniform(1000).
compute x425 = uniform(1000).
compute x426 = uniform(1000).
compute x427 = uniform(1000).
compute x428 = uniform(1000).
compute x429 = uniform(1000).
compute x430 = uniform(1000).
compute x431 = uniform(1000).
compute x432 = uniform(1000).
compute x433 = uniform(1000).
compute x434 = uniform(1000).
compute x435 = uniform(1000).
compute x436 = uniform(1000).
compute x437 = uniform(1000).
compute x438 = uniform(1000).
compute x439 = uniform(1000).
compute x440 = uniform(1000).
compute x441 = uniform(1000).
compute x442 = uniform(1000).
compute x443 = uniform(1000).
compute x444 = uniform(1000).
compute x445 = uniform(1000).
compute x446 = uniform(1000).
compute x447 = uniform(1000).
compute x448 = uniform(1000).
compute x449 = uniform(1000).
compute x450 = uniform(1000).
compute x451 = uniform(1000).
compute x452 = uniform(1000).
compute x453 = uniform(1000).
compute x454 = uniform(1000).
compute x455 = uniform(1000).
compute x456 = uniform(1000).
compute x457 = uniform(1000).
compute x458 = uniform(1000).
compute x459 = uniform(1000).
compute x460 = uniform(1000).
compute x461 = uniform(1000).
compute x462 = uniform(1000).
compute x463 = uniform(1000).
compute x464 = uniform(1000).
compute x465 = uniform(1000).
compute x466 = uniform(1000).
compute x467 = uniform(1000).
compute x468 = uniform(1000).
compute x469 = uniform(1000).
compute x470 = uniform(1000).
compute x471 = uniform(1000).
compute x472 = uniform(1000).
compute x473 = uniform(1000).
compute x474 = uniform(1000).
compute x475 = uniform(1000).
compute x476 = uniform(1000).
compute x477 = uniform(1000).
compute x478 = uniform(1000).
compute x479 = uniform(1000).
compute x480 = uniform(1000).
compute x481 = uniform(1000).
compute x482 = uniform(1000).
compute x483 = uniform(1000).
compute x484 = uniform(1000).
compute x485 = uniform(1000).
compute x486 = uniform(1000).
compute x487 = uniform(1000).
compute x488 = uniform(1000).
compute x489 = uniform(1000).
compute x490 = uniform(1000).
compute x491 = uniform(1000).
compute x492 = uniform(1000).
compute x493 = uniform(1000).
compute x494 = uniform(1000).
compute x495 = uniform(1000).
compute x496 = uniform(1000).
compute x497 = uniform(1000).
compute x498 = uniform(1000).
compute x499 = uniform(1000).
compute x500 = uniform(1000).
compute x501 = uniform(1000).
compute x502 = uniform(1000).
compute x503 = uniform(1000).
compute x504 = uniform(1000).
compute x505 = uniform(1000).
compute x506 = uniform(1000).
compute x507 = uniform(1000).
compute x508 = uniform(1000).
compute x509 = uniform(1000).
compute x510 = uniform(1000).
compute x511 = uniform(1000).
compute x512 = uniform(1000).
compute x513 = uniform(1000).
compute x514 = uniform(1000).
compute x515 = uniform(1000).
compute x516 = uniform(1000).
compute x517 = uniform(1000).
compute x518 = uniform(1000).
compute x519 = uniform(1000).
compute x520 = uniform(1000).
compute x521 = uniform(1000).
compute x522 = uniform(1000).
compute x523 = uniform(1000).
compute x524 = uniform(1000).
compute x525 = uniform(1000).
compute x526 = uniform(1000).
compute x527 = uniform(1000).
compute x528 = uniform(1000).
compute x529 = uniform(1000).
compute x530 = uniform(1000).
compute x531 = uniform(1000).
compute x532 = uniform(1000).
compute x533 = uniform(1000).
compute x534 = uniform(1000).
compute x535 = uniform(1000).
compute x536 = uniform(1000).
compute x537 = uniform(1000).
compute x538 = uniform(1000).
compute x539 = uniform(1000).
compute x540 = uniform(1000).
compute x541 = uniform(1000).
compute x542 = uniform(1000).
compute x543 = uniform(1000).
compute x544 = uniform(1000).
compute x545 = uniform(1000).
compute x546 = uniform(1000).
compute x547 = uniform(1000).
compute x548 = uniform(1000).
compute x549 = uniform(1000).
compute x550 = uniform(1000).
compute x551 = uniform(1000).
compute x552 = uniform(1000).
compute x553 = uniform(1000).
compute x554 = uniform(1000).
compute x555 = uniform(1000).
compute x556 = uniform(1000).
compute x557 = uniform(1000).
compute x558 = uniform(1000).
compute x559 = uniform(1000).
compute x560 = uniform(1000).
compute x561 = uniform(1000).
compute x562 = uniform(1000).
compute x563 = uniform(1000).
compute x564 = uniform(1000).
compute x565 = uniform(1000).
compute x566 = uniform(1000).
compute x567 = uniform(1000).
compute x568 = uniform(1000).
compute x569 = uniform(1000).
compute x570 = uniform(1000).
compute x571 = uniform(1000).
compute x572 = uniform(1000).
compute x573 = uniform(1000).
compute x574 = uniform(1000).
compute x575 = uniform(1000).
compute x576 = uniform(1000).
compute x577 = uniform(1000).
compute x578 = uniform(1000).
compute x579 = uniform(1000).
compute x580 = uniform(1000).
compute x581 = uniform(1000).
compute x582 = uniform(1000).
compute x583 = uniform(1000).
compute x584 = uniform(1000).
compute x585 = uniform(1000).
compute x586 = uniform(1000).
compute x587 = uniform(1000).
compute x588 = uniform(1000).
compute x589 = uniform(1000).
compute x590 = uniform(1000).
compute x591 = uniform(1000).
compute x592 = uniform(1000).
compute x593 = uniform(1000).
compute x594 = uniform(1000).
compute x595 = uniform(1000).
compute x596 = uniform(1000).
compute x597 = uniform(1000).
compute x598 = uniform(1000).
compute x599 = uniform(1000).
compute x600 = uniform(1000).
compute x601 = uniform(1000).
compute x602 = uniform(1000).
compute x603 = uniform(1000).
compute x604 = uniform(1000).
compute x605 = uniform(1000).
compute x606 = uniform(1000).
compute x607 = uniform(1000).
compute x608 = uniform(1000).
compute x609 = uniform(1000).
compute x610 = uniform(1000).
compute x611 = uniform(1000).
compute x612 = uniform(1000).
compute x613 = uniform(1000).
compute x614 = uniform(1000).
compute x615 = uniform(1000).
compute x616 = uniform(1000).
compute x617 = uniform(1000).
compute x618 = uniform(1000).
compute x619 = uniform(1000).
compute x620 = uniform(1000).
compute x621 = uniform(1000).
compute x622 = uniform(1000).
compute x623 = uniform(1000).
compute x624 = uniform(1000).
compute x625 = uniform(1000).
compute x626 = uniform(1000).
compute x627 = uniform(1000).
compute x628 = uniform(1000).
compute x629 = uniform(1000).
compute x630 = uniform(1000).
compute x631 = uniform(1000).
compute x632 = uniform(1000).
compute x633 = uniform(1000).
compute x634 = uniform(1000).
compute x635 = uniform(1000).
compute x636 = uniform(1000).
compute x637 = uniform(1000).
compute x638 = uniform(1000).
compute x639 = uniform(1000).
compute x640 = uniform(1000).
compute x641 = uniform(1000).
compute x642 = uniform(1000).
compute x643 = uniform(1000).
compute x644 = uniform(1000).
compute x645 = uniform(1000).
compute x646 = uniform(1000).
compute x647 = uniform(1000).
compute x648 = uniform(1000).
compute x649 = uniform(1000).
compute x650 = uniform(1000).
compute x651 = uniform(1000).
compute x652 = uniform(1000).
compute x653 = uniform(1000).
compute x654 = uniform(1000).
compute x655 = uniform(1000).
compute x656 = uniform(1000).
compute x657 = uniform(1000).
compute x658 = uniform(1000).
compute x659 = uniform(1000).
compute x660 = uniform(1000).
compute x661 = uniform(1000).
compute x662 = uniform(1000).
compute x663 = uniform(1000).
compute x664 = uniform(1000).
compute x665 = uniform(1000).
compute x666 = uniform(1000).
compute x667 = uniform(1000).
compute x668 = uniform(1000).
compute x669 = uniform(1000).
compute x670 = uniform(1000).
compute x671 = uniform(1000).
compute x672 = uniform(1000).
compute x673 = uniform(1000).
compute x674 = uniform(1000).
compute x675 = uniform(1000).
compute x676 = uniform(1000).
compute x677 = uniform(1000).
compute x678 = uniform(1000).
compute x679 = uniform(1000).
compute x680 = uniform(1000).
compute x681 = uniform(1000).
compute x682 = uniform(1000).
compute x683 = uniform(1000).
compute x684 = uniform(1000).
compute x685 = uniform(1000).
compute x686 = uniform(1000).
compute x687 = uniform(1000).
compute x688 = uniform(1000).
compute x689 = uniform(1000).
compute x690 = uniform(1000).
compute x691 = uniform(1000).
compute x692 = uniform(1000).
compute x693 = uniform(1000).
compute x694 = uniform(1000).
compute x695 = uniform(1000).
compute x696 = uniform(1000).
compute x697 = uniform(1000).
compute x698 = uniform(1000).
compute x699 = uniform(1000).
compute x700 = uniform(1000).
compute x701 = uniform(1000).
compute x702 = uniform(1000).
compute x703 = uniform(1000).
compute x704 = uniform(1000).
compute x705 = uniform(1000).
compute x706 = uniform(1000).
compute x707 = uniform(1000).
compute x708 = uniform(1000).
compute x709 = uniform(1000).
compute x710 = uniform(1000).
compute x711 = uniform(1000).
compute x712 = uniform(1000).
compute x713 = uniform(1000).
compute x714 = uniform(1000).
compute x715 = uniform(1000).
compute x716 = uniform(1000).
compute x717 = uniform(1000).
compute x718 = uniform(1000).
compute x719 = uniform(1000).
compute x720 = uniform(1000).
compute x721 = uniform(1000).
compute x722 = uniform(1000).
compute x723 = uniform(1000).
compute x724 = uniform(1000).
compute x725 = uniform(1000).
compute x726 = uniform(1000).
compute x727 = uniform(1000).
compute x728 = uniform(1000).
compute x729 = uniform(1000).
compute x730 = uniform(1000).
compute x731 = uniform(1000).
compute x732 = uniform(1000).
compute x733 = uniform(1000).
compute x734 = uniform(1000).
compute x735 = uniform(1000).
compute x736 = uniform(1000).
compute x737 = uniform(1000).
compute x738 = uniform(1000).
compute x739 = uniform(1000).
compute x740 = uniform(1000).
compute x741 = uniform(1000).
compute x742 = uniform(1000).
compute x743 = uniform(1000).
compute x744 = uniform(1000).
compute x745 = uniform(1000).
compute x746 = uniform(1000).
compute x747 = uniform(1000).
compute x748 = uniform(1000).
compute x749 = uniform(1000).
compute x750 = uniform(1000).
compute x751 = uniform(1000).
compute x752 = uniform(1000).
compute x753 = uniform(1000).
compute x754 = uniform(1000).
compute x755 = uniform(1000).
compute x756 = uniform(1000).
compute x757 = uniform(1000).
compute x758 = uniform(1000).
compute x759 = uniform(1000).
compute x760 = uniform(1000).
compute x761 = uniform(1000).
compute x762 = uniform(1000).
compute x763 = uniform(1000).
compute x764 = uniform(1000).
compute x765 = uniform(1000).
compute x766 = uniform(1000).
compute x767 = uniform(1000).
compute x768 = uniform(1000).
compute x769 = uniform(1000).
compute x770 = uniform(1000).
compute x771 = uniform(1000).
compute x772 = uniform(1000).
compute x773 = uniform(1000).
compute x774 = uniform(1000).
compute x775 = uniform(1000).
compute x776 = uniform(1000).
compute x777 = uniform(1000).
compute x778 = uniform(1000).
compute x779 = uniform(1000).
compute x780 = uniform(1000).
compute x781 = uniform(1000).
compute x782 = uniform(1000).
compute x783 = uniform(1000).
compute x784 = uniform(1000).
compute x785 = uniform(1000).
compute x786 = uniform(1000).
compute x787 = uniform(1000).
compute x788 = uniform(1000).
compute x789 = uniform(1000).
compute x790 = uniform(1000).
compute x791 = uniform(1000).
compute x792 = uniform(1000).
compute x793 = uniform(1000).
compute x794 = uniform(1000).
compute x795 = uniform(1000).
compute x796 = uniform(1000).
compute x797 = uniform(1000).
compute x798 = uniform(1000).
compute x799 = uniform(1000).
compute x800 = uniform(1000).
compute x801 = uniform(1000).
compute x802 = uniform(1000).
compute x803 = uniform(1000).
compute x804 = uniform(1000).
compute x805 = uniform(1000).
compute x806 = uniform(1000).
compute x807 = uniform(1000).
compute x808 = uniform(1000).
compute x809 = uniform(1000).
compute x810 = uniform(1000).
compute x811 = uniform(1000).
compute x812 = uniform(1000).
compute x813 = uniform(1000).
compute x814 = uniform(1000).
compute x815 = uniform(1000).
compute x816 = uniform(1000).
compute x817 = uniform(1000).
compute x818 = uniform(1000).
compute x819 = uniform(1000).
compute x820 = uniform(1000).
compute x821 = uniform(1000).
compute x822 = uniform(1000).
compute x823 = uniform(1000).
compute x824 = uniform(1000).
compute x825 = uniform(1000).
compute x826 = uniform(1000).
compute x827 = uniform(1000).
compute x828 = uniform(1000).
compute x829 = uniform(1000).
compute x830 = uniform(1000).
compute x831 = uniform(1000).
compute x832 = uniform(1000).
compute x833 = uniform(1000).
compute x834 = uniform(1000).
compute x835 = uniform(1000).
compute x836 = uniform(1000).
compute x837 = uniform(1000).
compute x838 = uniform(1000).
compute x839 = uniform(1000).
compute x840 = uniform(1000).
compute x841 = uniform(1000).
compute x842 = uniform(1000).
compute x843 = uniform(1000).
compute x844 = uniform(1000).
compute x845 = uniform(1000).
compute x846 = uniform(1000).
compute x847 = uniform(1000).
compute x848 = uniform(1000).
compute x849 = uniform(1000).
compute x850 = uniform(1000).
compute x851 = uniform(1000).
compute x852 = uniform(1000).
compute x853 = uniform(1000).
compute x854 = uniform(1000).
compute x855 = uniform(1000).
compute x856 = uniform(1000).
compute x857 = uniform(1000).
compute x858 = uniform(1000).
compute x859 = uniform(1000).
compute x860 = uniform(1000).
compute x861 = uniform(1000).
compute x862 = uniform(1000).
compute x863 = uniform(1000).
compute x864 = uniform(1000).
compute x865 = uniform(1000).
compute x866 = uniform(1000).
compute x867 = uniform(1000).
compute x868 = uniform(1000).
compute x869 = uniform(1000).
compute x870 = uniform(1000).
compute x871 = uniform(1000).
compute x872 = uniform(1000).
compute x873 = uniform(1000).
compute x874 = uniform(1000).
compute x875 = uniform(1000).
compute x876 = uniform(1000).
compute x877 = uniform(1000).
compute x878 = uniform(1000).
compute x879 = uniform(1000).
compute x880 = uniform(1000).
compute x881 = uniform(1000).
compute x882 = uniform(1000).
compute x883 = uniform(1000).
compute x884 = uniform(1000).
compute x885 = uniform(1000).
compute x886 = uniform(1000).
compute x887 = uniform(1000).
compute x888 = uniform(1000).
compute x889 = uniform(1000).
compute x890 = uniform(1000).
compute x891 = uniform(1000).
compute x892 = uniform(1000).
compute x893 = uniform(1000).
compute x894 = uniform(1000).
compute x895 = uniform(1000).
compute x896 = uniform(1000).
compute x897 = uniform(1000).
compute x898 = uniform(1000).
compute x899 = uniform(1000).
compute x900 = uniform(1000).
compute x901 = uniform(1000).
compute x902 = uniform(1000).
compute x903 = uniform(1000).
compute x904 = uniform(1000).
compute x905 = uniform(1000).
compute x906 = uniform(1000).
compute x907 = uniform(1000).
compute x908 = uniform(1000).
compute x909 = uniform(1000).
compute x910 = uniform(1000).
compute x911 = uniform(1000).
compute x912 = uniform(1000).
compute x913 = uniform(1000).
compute x914 = uniform(1000).
compute x915 = uniform(1000).
compute x916 = uniform(1000).
compute x917 = uniform(1000).
compute x918 = uniform(1000).
compute x919 = uniform(1000).
compute x920 = uniform(1000).
compute x921 = uniform(1000).
compute x922 = uniform(1000).
compute x923 = uniform(1000).
compute x924 = uniform(1000).
compute x925 = uniform(1000).
compute x926 = uniform(1000).
compute x927 = uniform(1000).
compute x928 = uniform(1000).
compute x929 = uniform(1000).
compute x930 = uniform(1000).
compute x931 = uniform(1000).
compute x932 = uniform(1000).
compute x933 = uniform(1000).
compute x934 = uniform(1000).
compute x935 = uniform(1000).
compute x936 = uniform(1000).
compute x937 = uniform(1000).
compute x938 = uniform(1000).
compute x939 = uniform(1000).
compute x940 = uniform(1000).
compute x941 = uniform(1000).
compute x942 = uniform(1000).
compute x943 = uniform(1000).
compute x944 = uniform(1000).
compute x945 = uniform(1000).
compute x946 = uniform(1000).
compute x947 = uniform(1000).
compute x948 = uniform(1000).
compute x949 = uniform(1000).
compute x950 = uniform(1000).
compute x951 = uniform(1000).
compute x952 = uniform(1000).
compute x953 = uniform(1000).
compute x954 = uniform(1000).
compute x955 = uniform(1000).
compute x956 = uniform(1000).
compute x957 = uniform(1000).
compute x958 = uniform(1000).
compute x959 = uniform(1000).
compute x960 = uniform(1000).
compute x961 = uniform(1000).
compute x962 = uniform(1000).
compute x963 = uniform(1000).
compute x964 = uniform(1000).
compute x965 = uniform(1000).
compute x966 = uniform(1000).
compute x967 = uniform(1000).
compute x968 = uniform(1000).
compute x969 = uniform(1000).
compute x970 = uniform(1000).
compute x971 = uniform(1000).
compute x972 = uniform(1000).
compute x973 = uniform(1000).
compute x974 = uniform(1000).
compute x975 = uniform(1000).
compute x976 = uniform(1000).
compute x977 = uniform(1000).
compute x978 = uniform(1000).
compute x979 = uniform(1000).
compute x980 = uniform(1000).
compute x981 = uniform(1000).
compute x982 = uniform(1000).
compute x983 = uniform(1000).
compute x984 = uniform(1000).
compute x985 = uniform(1000).
compute x986 = uniform(1000).
compute x987 = uniform(1000).
compute x988 = uniform(1000).
compute x989 = uniform(1000).
compute x990 = uniform(1000).
compute x991 = uniform(1000).
compute x992 = uniform(1000).
compute x993 = uniform(1000).
compute x994 = uniform(1000).
compute x995 = uniform(1000).
compute x996 = uniform(1000).
compute x997 = uniform(1000).
compute x998 = uniform(1000).
compute x999 = uniform(1000).
* fre x1 to x10.
execute.
host command = ['echo %time%'].
restore.
********************************************.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ All right, but apart from the sanitation, the medicine, education, wine, public order, irrigation, roads, a fresh water system, and public health, what have the Romans ever done for us? ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
Re: Insufficent Memory Error with Linear Mixed Models
|
Administrator
|
"I saw no improvements in processing speed for set workspace = !MAX_WORKSPACE and set workspace = !MIN_WORKSPACE. "
Albert-Jan - Where do you get the impression this has anything to do with processing speed? It has to do with allocation of memory. Unfortunately, to my knowledge, there is NO documentation as to which procedures benefit from the SET WORKSPACE. In my experience with older versions (11.5) MATRIX - END MATRIX can benefit a great deal in newer versions I am not so sure. Maybe JoNoH has some list he could post. MATRIX. COMPUTE bigone=MAKE(20000,20000,1). PRINT {NROW(bigone),NCOL(bigone)}. END MATRIX. MATRIX. COMPUTE bigone=MAKE(30000,30000,1). PRINT {NROW(bigone),NCOL(bigone)}. END MATRIX. PRESERVE. SET WORKSPACE 5000000 MATRIX. COMPUTE bigone=MAKE(40000,40000,1). PRINT {NROW(bigone),NCOL(bigone)}. END MATRIX. RESTORE.
Please reply to the list and not to my personal email.
Those desiring my consulting or training services please feel free to email me. --- "Nolite dare sanctum canibus neque mittatis margaritas vestras ante porcos ne forte conculcent eas pedibus suis." Cum es damnatorum possederunt porcos iens ut salire off sanguinum cliff in abyssum?" |
Re: Insufficent Memory Error with Linear Mixed Models
|
|
Hi David,
Yes, it would be interesting to know which procedures benefit from SET WORKSPACE (and, while we're at it, from SET MCACHE too). Your example reminded me of two 'growing objects' examples from the R Inferno. In the second example below, the memory space is pre-allocated, which is MUCH faster (and vec <- 1:n is still faster). Anyway, maybe I should have said "processing time" (or: researcher-idle-time) instead of "performance". # 1 vec <- numeric(0) for(i in 1:n) vec <- c(vec, i) # 2 vec <- numeric(n) for(i in 1:n) vec[i] <- i Regards, Albert-Jan ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ All right, but apart from the sanitation, the medicine, education, wine, public order, irrigation, roads, a fresh water system, and public health, what have the Romans ever done for us? ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
«
Return to SPSSX Discussion
|
1 view|%1 views
| Free forum by Nabble | Edit this page |