Main Page | Report this Page
 
   
Science Forum Index  »  Statistics - Education Forum  »  SPSS and Coefficient Hypothesis Testing...
Page 1 of 1    
Author Message
BenH34...
Posted: Thu Jul 31, 2008 7:53 am
Guest
Hello all.

I am a novice SPSS user, and cannot find a solution to a problem. I
am interested in finding a way to test if coefficient are
statistically different from each other. E.g. y = B1x1+ B2x2 + B3x3
+e. And the hypothesis test I want to perform is if B1-B2=0? In
Stata there is syntax to directly test this within the regression
run. Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal." http://www.nd.edu/~rwilliam/stats1/OLS-SPSS.pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben
Ray Koopman...
Posted: Thu Jul 31, 2008 1:37 pm
Guest
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:
Quote:
Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other. E.g. y = B1x1+ B2x2 + B3x3
+ e. And the hypothesis test I want to perform is if B1-B2=0? In
Stata there is syntax to directly test this within the regression
run. Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal." http://www.nd.edu/~rwilliam/stats1/OLS-SPSS.pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.
Ryan...
Posted: Thu Jul 31, 2008 3:47 pm
Guest
On Jul 31, 7:37 pm, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
Quote:
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:





Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other.  E.g. y = B1x1+ B2x2 + B3x3
+ e.  And the hypothesis test I want to perform is if B1-B2=0?  In
Stata there is syntax to directly test this within the regression
run.  Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal."  http://www.nd.edu/~rwilliam/stats1/OLS-SPSS.pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.- Hide quoted text -

- Show quoted text -

Hi Ray,

I'm always intrigued by your responses! I hope it's okay, but I have a
couple follow up questions. Just to make sure I understand, if you
wanted to know if any of the three "partial regression coefficients"
were different from each other, would you run three separate linear
regression analyses?...

Y= b0 + b1(x1+x2) + b2(x1-x2)

Y= b0+ b3(x2+x3) + b4(x2-x3)

Y= b0+ b5(x1+x3) + b6(x1-x3)

where

b2 reflects difference between partial weights for x1 and x2
b4 reflects difference between partial weights for x1 and x3
b6 reflects difference between partial weights for x2 and x3


This approach seems problematic to me because you're not taking into
consideration/statistically controlling for the third variable when
testing the differences.

Also, if you have the time, would you mind explaining why you need to
include the x1+x2, x2+x3, and x1+x3?

Sorry for so many questions. I completely understand if you're too
busy to respond.

Thank you,

Ryan
Ryan...
Posted: Thu Jul 31, 2008 3:54 pm
Guest
On Jul 31, 9:47 pm, Ryan <Ryan.Andrew.Bl... at (no spam) gmail.com> wrote:
Quote:
On Jul 31, 7:37 pm, Ray Koopman <koop... at (no spam) sfu.ca> wrote:





On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:

Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other.  E.g. y = B1x1+ B2x2 + B3x3
+ e.  And the hypothesis test I want to perform is if B1-B2=0?  In
Stata there is syntax to directly test this within the regression
run.  Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal."  http://www.nd.edu/~rwilliam/stats1/OLS-SPSS..pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.- Hide quoted text -

- Show quoted text -

Hi Ray,

I'm always intrigued by your responses! I hope it's okay, but I have a
couple follow up questions. Just to make sure I understand, if you
wanted to know if any of the three "partial regression coefficients"
were different from each other, would you run three separate linear
regression analyses?...

Y= b0 + b1(x1+x2) + b2(x1-x2)

Y= b0+ b3(x2+x3) + b4(x2-x3)

Y= b0+ b5(x1+x3) + b6(x1-x3)

where

b2 reflects difference between partial weights for x1 and x2
b4 reflects difference between partial weights for x1 and x3
b6 reflects difference between partial weights for x2 and x3

This approach seems problematic to me because you're not taking into
consideration/statistically controlling for the third variable when
testing the differences.

Also, if you have the time, would you mind explaining why you need to
include the x1+x2, x2+x3, and x1+x3?

Sorry for so many questions. I completely understand if you're too
busy to respond.

Thank you,

Ryan- Hide quoted text -

- Show quoted text -

Sorry for the double post, but I think I'm viewing this the wrong way.
I don't think it would make sense to control for the third variable.
The purpose of this analysis would be to see if the full regression
coefficients are different from each other. Anyway, I look forward to
your response.
Bruce Weaver...
Posted: Thu Jul 31, 2008 8:16 pm
Guest
Ray Koopman wrote:
Quote:
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:
Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other. E.g. y = B1x1+ B2x2 + B3x3
+ e. And the hypothesis test I want to perform is if B1-B2=0? In
Stata there is syntax to directly test this within the regression
run. Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal." http://www.nd.edu/~rwilliam/stats1/OLS-SPSS.pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.


Note to the OP: When posting the same question to multiple
groups, please cross-post (i.e., a single message posted to
multiple groups) rather than posting multiple messages. I
responded in the SPSS group, but Ray's method is far more elegant.

--
Bruce Weaver
bweaver at (no spam) lakeheadu.ca
www.angelfire.com/wv/bwhomedir
"When all else fails, RTFM."
Ray Koopman...
Posted: Thu Jul 31, 2008 9:43 pm
Guest
On Jul 31, 6:47 pm, Ryan <Ryan.Andrew.Bl... at (no spam) gmail.com> wrote:
Quote:
On Jul 31, 7:37 pm, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:

Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other. E.g. y = B1x1+ B2x2 + B3x3
+ e. And the hypothesis test I want to perform is if B1-B2=0? In
Stata there is syntax to directly test this within the regression
run. Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal." http://www.nd.edu/~rwilliam/stats1/OLS-SPSS.pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.

Hi Ray,

I'm always intrigued by your responses! I hope it's okay, but I have a
couple follow up questions. Just to make sure I understand, if you
wanted to know if any of the three "partial regression coefficients"
were different from each other, would you run three separate linear
regression analyses?...

Y= b0 + b1(x1+x2) + b2(x1-x2)

Y= b0+ b3(x2+x3) + b4(x2-x3)

Y= b0+ b5(x1+x3) + b6(x1-x3)

where

b2 reflects difference between partial weights for x1 and x2
b4 reflects difference between partial weights for x1 and x3
b6 reflects difference between partial weights for x2 and x3

This approach seems problematic to me because you're not taking into
consideration/statistically controlling for the third variable when
testing the differences.

Also, if you have the time, would you mind explaining why you need to
include the x1+x2, x2+x3, and x1+x3?

Sorry for so many questions. I completely understand if you're too
busy to respond.

Thank you,

Ryan

No, I'd do a different transformation, replacing {x1, x2, x3} with
{x1', x2' x3'} = {x1+x2+x3, 2x1-x2-x3, x2-x3}. Do it in two steps:
first put in x1', then add x2' and x3'. If the second step increases
R^2 significantly then you reject H: b1 = b2 = b3.

It may help to consider the general question: in a p-predictor model,
how can you test H: b1 = ... = bp? One way is a generalization of
the p=3 case above, the other is a generalization of the solution
Bruce posted in the SPSS-only version of this discussion. Of course,
the two solutions give the same answer, so they're really only two
different ways of thinking about the problem.
...
Posted: Fri Aug 01, 2008 5:27 am
Guest
On Aug 1, 3:43 am, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
Quote:
On Jul 31, 6:47 pm, Ryan <Ryan.Andrew.Bl... at (no spam) gmail.com> wrote:



On Jul 31, 7:37 pm, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:

Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other.  E.g. y = B1x1+ B2x2 + B3x3
+ e.  And the hypothesis test I want to perform is if B1-B2=0?  In
Stata there is syntax to directly test this within the regression
run.  Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal."  http://www.nd.edu/~rwilliam/stats1/OLS-SPSS..pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.

Hi Ray,

I'm always intrigued by your responses! I hope it's okay, but I have a
couple follow up questions. Just to make sure I understand, if you
wanted to know if any of the three "partial regression coefficients"
were different from each other, would you run three separate linear
regression analyses?...

Y= b0 + b1(x1+x2) + b2(x1-x2)

Y= b0+ b3(x2+x3) + b4(x2-x3)

Y= b0+ b5(x1+x3) + b6(x1-x3)

where

b2 reflects difference between partial weights for x1 and x2
b4 reflects difference between partial weights for x1 and x3
b6 reflects difference between partial weights for x2 and x3

This approach seems problematic to me because you're not taking into
consideration/statistically controlling for the third variable when
testing the differences.

Also, if you have the time, would you mind explaining why you need to
include the x1+x2, x2+x3, and x1+x3?

Sorry for so many questions. I completely understand if you're too
busy to respond.

Thank you,

Ryan

No, I'd do a different transformation, replacing {x1, x2, x3} with
{x1', x2' x3'} = {x1+x2+x3, 2x1-x2-x3, x2-x3}. Do it in two steps:
first put in x1', then add x2' and x3'. If the second step increases
R^2 significantly then you reject H: b1 = b2 = b3.

It may help to consider the general question: in a p-predictor model,
how can you test H: b1 = ... = bp? One way is a generalization of
the p=3 case above, the other is a generalization of the solution
Bruce posted in the SPSS-only version of this discussion. Of course,
the two solutions give the same answer, so they're really only two
different ways of thinking about the problem.

All very elegant ways to do it, but if the goal is to have the
parameter estimates of x1, x2, and x3 as part of the output, you would
have to do the math outside of SPSS to get the true parameter
estimates. I too am new to SPSS, but know in programs like SAS you
can take the output of the regression as a data set. Within a data
step (again SAS parlance for a set of syntax that manipulates the data
set), you should be able to construct the necessary t-statistic with
the parameter estimates, their variance and covariances (provided you
can output these as well from the regression into a data set) and ask
the package for the p-value of this statistic. Is this possible to do
in SPSS?
BenH34...
Posted: Fri Aug 01, 2008 5:35 am
Guest
Thanks Ray (& Ryan). Again sorry for not cross posting.
...
Posted: Fri Aug 01, 2008 6:06 am
Guest
On Aug 1, 11:46 am, Richard Startz <richardstar... at (no spam) comcast.net> wrote:
Quote:
On Fri, 1 Aug 2008 08:27:02 -0700 (PDT), pcapp... at (no spam) yahoo.com wrote:
On Aug 1, 3:43 am, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 6:47 pm, Ryan <Ryan.Andrew.Bl... at (no spam) gmail.com> wrote:

On Jul 31, 7:37 pm, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:

Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other.  E.g. y = B1x1+ B2x2 + B3x3
+ e.  And the hypothesis test I want to perform is if B1-B2=0?  In
Stata there is syntax to directly test this within the regression
run.  Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal."  http://www.nd.edu/~rwilliam/stats1/OLS-SPSS.pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.

Hi Ray,

I'm always intrigued by your responses! I hope it's okay, but I have a
couple follow up questions. Just to make sure I understand, if you
wanted to know if any of the three "partial regression coefficients"
were different from each other, would you run three separate linear
regression analyses?...

Y= b0 + b1(x1+x2) + b2(x1-x2)

Y= b0+ b3(x2+x3) + b4(x2-x3)

Y= b0+ b5(x1+x3) + b6(x1-x3)

where

b2 reflects difference between partial weights for x1 and x2
b4 reflects difference between partial weights for x1 and x3
b6 reflects difference between partial weights for x2 and x3

This approach seems problematic to me because you're not taking into
consideration/statistically controlling for the third variable when
testing the differences.

Also, if you have the time, would you mind explaining why you need to
include the x1+x2, x2+x3, and x1+x3?

Sorry for so many questions. I completely understand if you're too
busy to respond.

Thank you,

Ryan

No, I'd do a different transformation, replacing {x1, x2, x3} with
{x1', x2' x3'} = {x1+x2+x3, 2x1-x2-x3, x2-x3}. Do it in two steps:
first put in x1', then add x2' and x3'. If the second step increases
R^2 significantly then you reject H: b1 = b2 = b3.

It may help to consider the general question: in a p-predictor model,
how can you test H: b1 = ... = bp? One way is a generalization of
the p=3 case above, the other is a generalization of the solution
Bruce posted in the SPSS-only version of this discussion. Of course,
the two solutions give the same answer, so they're really only two
different ways of thinking about the problem.

All very elegant ways to do it, but if the goal is to have the
parameter estimates of x1, x2, and x3 as part of the output, you would
have to do the math outside of SPSS to get the true parameter
estimates.  I too am new to SPSS, but know in programs like SAS you
can take the output of the regression as a data set.  Within a data
step (again SAS parlance for a set of syntax that manipulates the data
set), you should be able to construct the necessary t-statistic with
the parameter estimates, their variance and covariances (provided you
can output these as well from the regression into a data set) and ask
the package for the p-value of this statistic.  Is this possible to do
in SPSS?

If you want to test b1=b2=b3, you will need to do an F-test. A series
of t-tests won't do it.
-Dick Startz

Right. I should have been more specific... I was thinking in terms of
the original posting which seemed to be interested in testing the
parameter estimates pairwise (i.e., b1=b2, b2=b3, etc.), not testing
them all for equality. The pairwise test is a t-test, while the three
way test would be an F-test. Sorry for the confusion. My question
still stands though.... can one construct the test statistic from the
model output in a separate data step?
Ryan...
Posted: Fri Aug 01, 2008 8:51 am
Guest
On Aug 1, 3:43 am, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
Quote:
On Jul 31, 6:47 pm, Ryan <Ryan.Andrew.Bl... at (no spam) gmail.com> wrote:





On Jul 31, 7:37 pm, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:

Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other.  E.g. y = B1x1+ B2x2 + B3x3
+ e.  And the hypothesis test I want to perform is if B1-B2=0?  In
Stata there is syntax to directly test this within the regression
run.  Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal."  http://www.nd.edu/~rwilliam/stats1/OLS-SPSS..pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.

Hi Ray,

I'm always intrigued by your responses! I hope it's okay, but I have a
couple follow up questions. Just to make sure I understand, if you
wanted to know if any of the three "partial regression coefficients"
were different from each other, would you run three separate linear
regression analyses?...

Y= b0 + b1(x1+x2) + b2(x1-x2)

Y= b0+ b3(x2+x3) + b4(x2-x3)

Y= b0+ b5(x1+x3) + b6(x1-x3)

where

b2 reflects difference between partial weights for x1 and x2
b4 reflects difference between partial weights for x1 and x3
b6 reflects difference between partial weights for x2 and x3

This approach seems problematic to me because you're not taking into
consideration/statistically controlling for the third variable when
testing the differences.

Also, if you have the time, would you mind explaining why you need to
include the x1+x2, x2+x3, and x1+x3?

Sorry for so many questions. I completely understand if you're too
busy to respond.

Thank you,

Ryan

No, I'd do a different transformation, replacing {x1, x2, x3} with
{x1', x2' x3'} = {x1+x2+x3, 2x1-x2-x3, x2-x3}. Do it in two steps:
first put in x1', then add x2' and x3'. If the second step increases
R^2 significantly then you reject H: b1 = b2 = b3.

It may help to consider the general question: in a p-predictor model,
how can you test H: b1 = ... = bp? One way is a generalization of
the p=3 case above, the other is a generalization of the solution
Bruce posted in the SPSS-only version of this discussion. Of course,
the two solutions give the same answer, so they're really only two
different ways of thinking about the problem.- Hide quoted text -

- Show quoted text -

Thank you.
Richard Startz...
Posted: Fri Aug 01, 2008 10:46 am
Guest
On Fri, 1 Aug 2008 08:27:02 -0700 (PDT), pcappers at (no spam) yahoo.com wrote:

Quote:
On Aug 1, 3:43 am, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 6:47 pm, Ryan <Ryan.Andrew.Bl... at (no spam) gmail.com> wrote:



On Jul 31, 7:37 pm, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:

Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other.  E.g. y = B1x1+ B2x2 + B3x3
+ e.  And the hypothesis test I want to perform is if B1-B2=0?  In
Stata there is syntax to directly test this within the regression
run.  Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal."  http://www.nd.edu/~rwilliam/stats1/OLS-SPSS.pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.

Hi Ray,

I'm always intrigued by your responses! I hope it's okay, but I have a
couple follow up questions. Just to make sure I understand, if you
wanted to know if any of the three "partial regression coefficients"
were different from each other, would you run three separate linear
regression analyses?...

Y= b0 + b1(x1+x2) + b2(x1-x2)

Y= b0+ b3(x2+x3) + b4(x2-x3)

Y= b0+ b5(x1+x3) + b6(x1-x3)

where

b2 reflects difference between partial weights for x1 and x2
b4 reflects difference between partial weights for x1 and x3
b6 reflects difference between partial weights for x2 and x3

This approach seems problematic to me because you're not taking into
consideration/statistically controlling for the third variable when
testing the differences.

Also, if you have the time, would you mind explaining why you need to
include the x1+x2, x2+x3, and x1+x3?

Sorry for so many questions. I completely understand if you're too
busy to respond.

Thank you,

Ryan

No, I'd do a different transformation, replacing {x1, x2, x3} with
{x1', x2' x3'} = {x1+x2+x3, 2x1-x2-x3, x2-x3}. Do it in two steps:
first put in x1', then add x2' and x3'. If the second step increases
R^2 significantly then you reject H: b1 = b2 = b3.

It may help to consider the general question: in a p-predictor model,
how can you test H: b1 = ... = bp? One way is a generalization of
the p=3 case above, the other is a generalization of the solution
Bruce posted in the SPSS-only version of this discussion. Of course,
the two solutions give the same answer, so they're really only two
different ways of thinking about the problem.

All very elegant ways to do it, but if the goal is to have the
parameter estimates of x1, x2, and x3 as part of the output, you would
have to do the math outside of SPSS to get the true parameter
estimates. I too am new to SPSS, but know in programs like SAS you
can take the output of the regression as a data set. Within a data
step (again SAS parlance for a set of syntax that manipulates the data
set), you should be able to construct the necessary t-statistic with
the parameter estimates, their variance and covariances (provided you
can output these as well from the regression into a data set) and ask
the package for the p-value of this statistic. Is this possible to do
in SPSS?

If you want to test b1=b2=b3, you will need to do an F-test. A series
of t-tests won't do it.
-Dick Startz
Richard Startz...
Posted: Fri Aug 01, 2008 11:28 am
Guest
On Fri, 1 Aug 2008 09:06:43 -0700 (PDT), pcappers at (no spam) yahoo.com wrote:

Quote:
On Aug 1, 11:46 am, Richard Startz <richardstar... at (no spam) comcast.net> wrote:
On Fri, 1 Aug 2008 08:27:02 -0700 (PDT), pcapp... at (no spam) yahoo.com wrote:
On Aug 1, 3:43 am, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 6:47 pm, Ryan <Ryan.Andrew.Bl... at (no spam) gmail.com> wrote:

On Jul 31, 7:37 pm, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:

Hello all.

I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other.  E.g. y = B1x1+ B2x2 + B3x3
+ e.  And the hypothesis test I want to perform is if B1-B2=0?  In
Stata there is syntax to directly test this within the regression
run.  Is the same true in SPSS?

The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal."  http://www.nd.edu/~rwilliam/stats1/OLS-SPSS.pdf

I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.

Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?

Thanks,

Ben

Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.

Hi Ray,

I'm always intrigued by your responses! I hope it's okay, but I have a
couple follow up questions. Just to make sure I understand, if you
wanted to know if any of the three "partial regression coefficients"
were different from each other, would you run three separate linear
regression analyses?...

Y= b0 + b1(x1+x2) + b2(x1-x2)

Y= b0+ b3(x2+x3) + b4(x2-x3)

Y= b0+ b5(x1+x3) + b6(x1-x3)

where

b2 reflects difference between partial weights for x1 and x2
b4 reflects difference between partial weights for x1 and x3
b6 reflects difference between partial weights for x2 and x3

This approach seems problematic to me because you're not taking into
consideration/statistically controlling for the third variable when
testing the differences.

Also, if you have the time, would you mind explaining why you need to
include the x1+x2, x2+x3, and x1+x3?

Sorry for so many questions. I completely understand if you're too
busy to respond.

Thank you,

Ryan

No, I'd do a different transformation, replacing {x1, x2, x3} with
{x1', x2' x3'} = {x1+x2+x3, 2x1-x2-x3, x2-x3}. Do it in two steps:
first put in x1', then add x2' and x3'. If the second step increases
R^2 significantly then you reject H: b1 = b2 = b3.

It may help to consider the general question: in a p-predictor model,
how can you test H: b1 = ... = bp? One way is a generalization of
the p=3 case above, the other is a generalization of the solution
Bruce posted in the SPSS-only version of this discussion. Of course,
the two solutions give the same answer, so they're really only two
different ways of thinking about the problem.

All very elegant ways to do it, but if the goal is to have the
parameter estimates of x1, x2, and x3 as part of the output, you would
have to do the math outside of SPSS to get the true parameter
estimates.  I too am new to SPSS, but know in programs like SAS you
can take the output of the regression as a data set.  Within a data
step (again SAS parlance for a set of syntax that manipulates the data
set), you should be able to construct the necessary t-statistic with
the parameter estimates, their variance and covariances (provided you
can output these as well from the regression into a data set) and ask
the package for the p-value of this statistic.  Is this possible to do
in SPSS?

If you want to test b1=b2=b3, you will need to do an F-test. A series
of t-tests won't do it.
-Dick Startz

Right. I should have been more specific... I was thinking in terms of
the original posting which seemed to be interested in testing the
parameter estimates pairwise (i.e., b1=b2, b2=b3, etc.), not testing
them all for equality. The pairwise test is a t-test, while the three
way test would be an F-test. Sorry for the confusion. My question
still stands though.... can one construct the test statistic from the
model output in a separate data step?

I'm not sure about what you can talk SPSS into (which I realize isn't
so helpful to the OP), but if you can grab the sum of squared
residuals from the regression then you can compute the F-stat.

1. Run the regression, grab the sum of squared residuals, call it
SSR1.
2. Re-run the regression rewritten so that the coefficient
restrictions have to be true. For example, y=b*(x1+x2+x3). Call the
sum of squared residuals SSR2.

3. Then you can compute the F-statistic by
[(SSR2-SSR1)/q]/(SSR1/(n-k))

which will be distributed F(q,n-k) where q is the number of equal
signs in the coefficient restrictions, n is the number of
observations, and k is the number of coefficients (including the
constant) in regression 1.

-Dick Startz
Bruce Weaver...
Posted: Fri Aug 01, 2008 1:14 pm
Guest
[ cross-posted to comp.soft-sys.stat.spss, where a parallel
discussion has been going on ]

pcappers at (no spam) yahoo.com wrote:
Quote:
On Aug 1, 3:43 am, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 6:47 pm, Ryan <Ryan.Andrew.Bl... at (no spam) gmail.com> wrote:



On Jul 31, 7:37 pm, Ray Koopman <koop... at (no spam) sfu.ca> wrote:
On Jul 31, 10:53 am, BenH34 <benho... at (no spam) earthlink.net> wrote:
Hello all.
I am a novice SPSS user, and cannot find a solution to a problem.
I am interested in finding a way to test if coefficient are
statistically different from each other. E.g. y = B1x1+ B2x2 + B3x3
+ e. And the hypothesis test I want to perform is if B1-B2=0? In
Stata there is syntax to directly test this within the regression
run. Is the same true in SPSS?
The only mention I could find online is:
"Unfortunately, unlike Stata, SPSS does not provide a convenient way
to test hypotheses like â1 = â2, e.g. the effects of education and job
experience are equal." http://www.nd.edu/~rwilliam/stats1/OLS-SPSS.pdf
I will ultimately have to perform 100s of these tests and am hopefuly
I can write the tests directly into the regression syntax.
Any ideas on where I can look for samples of syntax to do this (and
other creative hypothisis testing of regression results)?
Thanks,
Ben
Run the regression with x1 and x2 replaced by their sum and
difference, x1+x2 and x1-x2. Then the test of the coefficient
of the difference is equivalent to a test of the difference
between B1 and B2.
Hi Ray,
I'm always intrigued by your responses! I hope it's okay, but I have a
couple follow up questions. Just to make sure I understand, if you
wanted to know if any of the three "partial regression coefficients"
were different from each other, would you run three separate linear
regression analyses?...
Y= b0 + b1(x1+x2) + b2(x1-x2)
Y= b0+ b3(x2+x3) + b4(x2-x3)
Y= b0+ b5(x1+x3) + b6(x1-x3)
where
b2 reflects difference between partial weights for x1 and x2
b4 reflects difference between partial weights for x1 and x3
b6 reflects difference between partial weights for x2 and x3
This approach seems problematic to me because you're not taking into
consideration/statistically controlling for the third variable when
testing the differences.
Also, if you have the time, would you mind explaining why you need to
include the x1+x2, x2+x3, and x1+x3?
Sorry for so many questions. I completely understand if you're too
busy to respond.
Thank you,
Ryan
No, I'd do a different transformation, replacing {x1, x2, x3} with
{x1', x2' x3'} = {x1+x2+x3, 2x1-x2-x3, x2-x3}. Do it in two steps:
first put in x1', then add x2' and x3'. If the second step increases
R^2 significantly then you reject H: b1 = b2 = b3.

It may help to consider the general question: in a p-predictor model,
how can you test H: b1 = ... = bp? One way is a generalization of
the p=3 case above, the other is a generalization of the solution
Bruce posted in the SPSS-only version of this discussion. Of course,
the two solutions give the same answer, so they're really only two
different ways of thinking about the problem.

All very elegant ways to do it, but if the goal is to have the
parameter estimates of x1, x2, and x3 as part of the output, you would
have to do the math outside of SPSS to get the true parameter
estimates. I too am new to SPSS, but know in programs like SAS you
can take the output of the regression as a data set. Within a data
step (again SAS parlance for a set of syntax that manipulates the data
set), you should be able to construct the necessary t-statistic with
the parameter estimates, their variance and covariances (provided you
can output these as well from the regression into a data set) and ask
the package for the p-value of this statistic. Is this possible to do
in SPSS?

For ages, the SPSS REGRESSION procedure has had the capability of
saving the model parameters to a file. I don't have SPSS on this
machine, so cannot give you the specifics, but you'll find them in
the help files.

For the last few versions, SPSS has also had the OMS command
(output management system), which allows you to direct any output
to a file (with several file formats available). I referred to
this in the parallel thread in the SPSS group, as did Jon Peck.
Look it up in the help files, and see the examples in Raynald
Levesque's book on data management for SPSS, which is freely
available here:

www.spss.com/statistics/base/data_management_book.htm

While you're reading the help files, also look at the various
DATASET commands, which enable you to have multiple data sets open
(e.g., one for the raw data, one for the table of coefficients,
one for the covariance matrix of the coefficients).

--
Bruce Weaver
bweaver at (no spam) lakeheadu.ca
www.angelfire.com/wv/bwhomedir
"When all else fails, RTFM."
 
Page 1 of 1       All times are GMT - 5 Hours
The time now is Fri Jan 09, 2009 11:30 pm