On survey issues

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

On survey issues

Haijie Ding
Dear Lister,
I am working in a consultancy company. To get a better picture of our
clients, we need to send a few (3-5) surveys (the question format is
different from this survey to another) instead of only one. It will take
40-60 minutes to answer all of them. Here we have two solusions.
One is to put all of the surveys together and users ony need to click one
link and finish all of the surveys. The second solusion is to ask them to do
all of them seperately. Then they need to click 3-5 links.
My question is: from user's perspective (How do they think of them? ) and
response rate consideration (we want a higher response rate), which solusion
is more applicable.

I know this question is not directly related to SPSS usage. However, i have
learnt so much from this list and rely on it so much. So, i only put this
question here.

Thank you in advance!

Bests,

Haijie Ding, Ph D,
Cognitive Psychologist,
Ideation Group, Haworth Furntiure

+86 137 0185 2316
+86 21 63847799
Reply | Threaded
Open this post in threaded view
|

Re: On survey issues

Dominic Lusinchi
Your query raises many questions.

40 to 60 minutes is a lot of time to spend on a self-administered
questionnaire. Why 3 to 5 surveys? Etc.

If this is how you plan to survey your customers in the future, I would take
the opportunity to set up a test with the upcoming survey, and thereby
obtain data to answer your two questions: which of the two options yields a
higher response rate - if this is the main metric you are interested in.
There are other additional measures to evaluate the quality of a survey
(e.g., item response rate).

The experiment would consist in randomly assigning participants to one or
the other option. At the end of the field period you can then evaluate the
differences between the two options in terms of survey quality.

Good luck.

Dominic Lusinchi
Statistician
Far West Research
Statistical Consulting
San Francisco, California
415-664-3032
www.farwestresearch.com

-----Original Message-----
From: SPSSX(r) Discussion [mailto:[hidden email]] On Behalf Of
Haijie Ding
Sent: Tuesday, November 14, 2006 7:03 PM
To: [hidden email]
Subject: On survey issues

Dear Lister,
I am working in a consultancy company. To get a better picture of our
clients, we need to send a few (3-5) surveys (the question format is
different from this survey to another) instead of only one. It will take
40-60 minutes to answer all of them. Here we have two solusions.
One is to put all of the surveys together and users ony need to click one
link and finish all of the surveys. The second solusion is to ask them to do
all of them seperately. Then they need to click 3-5 links.
My question is: from user's perspective (How do they think of them? ) and
response rate consideration (we want a higher response rate), which solusion
is more applicable.

I know this question is not directly related to SPSS usage. However, i have
learnt so much from this list and rely on it so much. So, i only put this
question here.

Thank you in advance!

Bests,

Haijie Ding, Ph D,
Cognitive Psychologist,
Ideation Group, Haworth Furntiure

+86 137 0185 2316
+86 21 63847799
Reply | Threaded
Open this post in threaded view
|

Re: On survey issues

Philip_Moore
In reply to this post by Haijie Ding
Dr Ding,

The only rationale for creating a single survey of this length would be
some kind of exploratory cluster analysis where you don't know ahead of
time how the different measures might be related to one another.  I presume
this is a B2B survey and you have a limited universe of potential
respondents.  Otherwise, I would break the survey up into as many smaller
units as possible.

Good luck,

Philip Moore
Market Research Manager
CarMax, the Auto Superstore
named America's Most Admired Auto Retailer
by Fortune Magazine, 2006



             Haijie Ding
             <haijie.ding@gmai
             l.com>                                                     To
             Sent by:                  [hidden email]
             "SPSSX(r)                                                  cc
             Discussion"
             <SPSSX-L@LISTSERV                                     Subject
             .UGA.EDU>                 On survey issues


             11/14/2006 10:02
             PM


             Please respond to
                Haijie Ding
             <haijie.ding@gmai
                  l.com>






Dear Lister,
I am working in a consultancy company. To get a better picture of our
clients, we need to send a few (3-5) surveys (the question format is
different from this survey to another) instead of only one. It will take
40-60 minutes to answer all of them. Here we have two solusions.
One is to put all of the surveys together and users ony need to click one
link and finish all of the surveys. The second solusion is to ask them to
do
all of them seperately. Then they need to click 3-5 links.
My question is: from user's perspective (How do they think of them? ) and
response rate consideration (we want a higher response rate), which
solusion
is more applicable.

I know this question is not directly related to SPSS usage. However, i have
learnt so much from this list and rely on it so much. So, i only put this
question here.

Thank you in advance!

Bests,

Haijie Ding, Ph D,
Cognitive Psychologist,
Ideation Group, Haworth Furntiure

+86 137 0185 2316
+86 21 63847799
Reply | Threaded
Open this post in threaded view
|

Re: On survey issues

Gary Oliver
In reply to this post by Dominic Lusinchi
Hi

Does anyone know of any academic (refereed) papers supporting the
break-up of the survey into 3-5 smaller units?

Warm regards/gary



>>-----Original Message-----
>>From: SPSSX(r) Discussion [mailto:[hidden email]]
>>On Behalf Of Dominic Lusinchi
>>Sent: Wednesday, November 15, 2006 5:55 PM
>>To: [hidden email]
>>Subject: Re: On survey issues
>>
>>Your query raises many questions.
>>
>>40 to 60 minutes is a lot of time to spend on a
>>self-administered questionnaire. Why 3 to 5 surveys? Etc.
>>
>>If this is how you plan to survey your customers in the
>>future, I would take the opportunity to set up a test with
>>the upcoming survey, and thereby obtain data to answer your
>>two questions: which of the two options yields a higher
>>response rate - if this is the main metric you are interested in.
>>There are other additional measures to evaluate the quality
>>of a survey (e.g., item response rate).
>>
>>The experiment would consist in randomly assigning
>>participants to one or the other option. At the end of the
>>field period you can then evaluate the differences between
>>the two options in terms of survey quality.
>>
>>Good luck.
>>
>>Dominic Lusinchi
>>Statistician
>>Far West Research
>>Statistical Consulting
>>San Francisco, California
>>415-664-3032
>>www.farwestresearch.com
>>
>>-----Original Message-----
>>From: SPSSX(r) Discussion [mailto:[hidden email]]
>>On Behalf Of Haijie Ding
>>Sent: Tuesday, November 14, 2006 7:03 PM
>>To: [hidden email]
>>Subject: On survey issues
>>
>>Dear Lister,
>>I am working in a consultancy company. To get a better
>>picture of our clients, we need to send a few (3-5) surveys
>>(the question format is different from this survey to
>>another) instead of only one. It will take 40-60 minutes to
>>answer all of them. Here we have two solusions.
>>One is to put all of the surveys together and users ony need
>>to click one link and finish all of the surveys. The second
>>solusion is to ask them to do all of them seperately. Then
>>they need to click 3-5 links.
>>My question is: from user's perspective (How do they think of
>>them? ) and response rate consideration (we want a higher
>>response rate), which solusion is more applicable.
>>
>>I know this question is not directly related to SPSS usage.
>>However, i have learnt so much from this list and rely on it
>>so much. So, i only put this question here.
>>
>>Thank you in advance!
>>
>>Bests,
>>
>>Haijie Ding, Ph D,
>>Cognitive Psychologist,
>>Ideation Group, Haworth Furntiure
>>
>>+86 137 0185 2316
>>+86 21 63847799
>>
Reply | Threaded
Open this post in threaded view
|

Re: On survey issues

Haijie Ding
Dear listers,
Thank you very much for your kind reply.
A little clarify:
(1) To get an understanding on different aspects (employees' workstyle,
organizational culture, Interaction issues, employees' perception on their
current working environments and so on), we need(want) to use a few instead
of only one survey to do it.
(2) The seperate surveys are well developed (some of them are adopted from
accdemic standard survey).
(3) We also want to do cross-survey analysis
(4)To do all of them, it will take 35-50 minutes. (around 100-120questions
total)
(5) we care a lot about response rate
(6) The format (scale, methods to answer) is a little different (Maybe we
will change them into the same if necessary).

So, how do you think of the two solutions? Do it seperately or combine them
together?

I was trying to search the relevant information, but didn't find so much,
could you guys also give me some reference on this topic?

Bests
Haijie

Haijie Ding, Ph D,
Cognitive Psychologist,
Ideation Department, Haworth Furniture Inc.

[hidden email]
[hidden email]
+86 21 6384 7799
+86 1370 185 2316



On 11/16/06, Gary Oliver <[hidden email]> wrote:

>
> Hi
>
> Does anyone know of any academic (refereed) papers supporting the
> break-up of the survey into 3-5 smaller units?
>
> Warm regards/gary
>
>
>
> >>-----Original Message-----
> >>From: SPSSX(r) Discussion [mailto:[hidden email]]
> >>On Behalf Of Dominic Lusinchi
> >>Sent: Wednesday, November 15, 2006 5:55 PM
> >>To: [hidden email]
> >>Subject: Re: On survey issues
> >>
> >>Your query raises many questions.
> >>
> >>40 to 60 minutes is a lot of time to spend on a
> >>self-administered questionnaire. Why 3 to 5 surveys? Etc.
> >>
> >>If this is how you plan to survey your customers in the
> >>future, I would take the opportunity to set up a test with
> >>the upcoming survey, and thereby obtain data to answer your
> >>two questions: which of the two options yields a higher
> >>response rate - if this is the main metric you are interested in.
> >>There are other additional measures to evaluate the quality
> >>of a survey (e.g., item response rate).
> >>
> >>The experiment would consist in randomly assigning
> >>participants to one or the other option. At the end of the
> >>field period you can then evaluate the differences between
> >>the two options in terms of survey quality.
> >>
> >>Good luck.
> >>
> >>Dominic Lusinchi
> >>Statistician
> >>Far West Research
> >>Statistical Consulting
> >>San Francisco, California
> >>415-664-3032
> >>www.farwestresearch.com
> >>
> >>-----Original Message-----
> >>From: SPSSX(r) Discussion [mailto:[hidden email]]
> >>On Behalf Of Haijie Ding
> >>Sent: Tuesday, November 14, 2006 7:03 PM
> >>To: [hidden email]
> >>Subject: On survey issues
> >>
> >>Dear Lister,
> >>I am working in a consultancy company. To get a better
> >>picture of our clients, we need to send a few (3-5) surveys
> >>(the question format is different from this survey to
> >>another) instead of only one. It will take 40-60 minutes to
> >>answer all of them. Here we have two solusions.
> >>One is to put all of the surveys together and users ony need
> >>to click one link and finish all of the surveys. The second
> >>solusion is to ask them to do all of them seperately. Then
> >>they need to click 3-5 links.
> >>My question is: from user's perspective (How do they think of
> >>them? ) and response rate consideration (we want a higher
> >>response rate), which solusion is more applicable.
> >>
> >>I know this question is not directly related to SPSS usage.
> >>However, i have learnt so much from this list and rely on it
> >>so much. So, i only put this question here.
> >>
> >>Thank you in advance!
> >>
> >>Bests,
> >>
> >>Haijie Ding, Ph D,
> >>Cognitive Psychologist,
> >>Ideation Group, Haworth Furntiure
> >>
> >>+86 137 0185 2316
> >>+86 21 63847799
> >>
>