| |
 |
|
|
Science Forum Index » Geology - Earthquakes Forum » Musings on evaluation
Page 4 of 4 Goto page Previous 1, 2, 3, 4
|
| Author |
Message |
| Skywise |
Posted: Tue Jan 29, 2008 5:11 pm |
|
|
|
Guest
|
Hatunen <hatunen@cox.net> wrote in news:h4vup39v94ss97afurog12orv05giu6q75@
4ax.com:
Quote: On Tue, 29 Jan 2008 18:14:30 -0000, Skywise
into@oblivion.nothing.com> wrote:
Hatunen <hatunen@cox.net> wrote in
news:bppup39asup0fnqefnfsnq8p60hpf2gjno@4ax.com:
Simply make a prediction as to range, like "between 6.0 and 7.0",
or even "6.0 or greater" and then ruthlessly exclude anything
outside the range.
And what happens when a M5.9 or M7.1 quake strikes within the time
and location of the perdiction?
What does "ruthlessly" mean?
What if there's and M5.5? Or a M5.2? Should they count?
The predictor is free to make his bounds as loose or as tight as
he (or she) wishes, and if his method is any good he will be able
to set those bounds. If his method may lead to this sort of
result he/she needs to cover it, perhaps by explicitly defining
such deviations as may be acceptable. The important thing is
clear criteria which do not have to be fudged in any way, post
facto, to make the facts fit the theory.
My point was that, post facto, the predictor will try to claim
"close enough". And when you or I say "HEY!!! Not fair!", we
get dismissed with the usual ad hominems.
The issue here is that we need to make the effort to bring the
predictor and the evaluator to the same game. As it is now
the two sides are playing by different rules, which makes all
of this effort not much more than preaching to the choir, for
BOTH sides.
Quote: One problem is that it is so easy to toss around simple numbers
like 8.0 without accounting for what they really stand for. In my
example of "between 6.0 and 7.0" energy values of over thirty
times are being covered. Your example of 5.9 would be an
earthquake of something like one-third the energy of the 6.0.
If you were to say "5.0 to 7.0" then you are covering an energy
range of 1000:1. Any proper theory should be able to fit into a
range as wide as these. In fact, from a sort of common sense
standpoint, it would seem that any predictive theory should be
able to cover an energy release range of no more than, say, 10:1.
I'm not convinced that making an issue out of the logarithmic
scale will solve anything. The dynamic range of potential
earthquake energies is just too vast to work with linear
values.
Furthermore, a prediction of "5-6" with a miss at 4.9 is off
by the same relative amount as a prediction of "7-8" with a
miss of 6.9. So what's the diff?
Brian
--
http://www.skywise711.com - Lasers, Seismology, Astronomy, Skepticism
Seismic FAQ: http://www.skywise711.com/SeismicFAQ/SeismicFAQ.html
Quake "predictions": http://www.skywise711.com/quakes/EQDB/index.html
Sed quis custodiet ipsos Custodes? |
|
|
| Back to top |
|
| Hatunen |
Posted: Tue Jan 29, 2008 5:16 pm |
|
|
|
Guest
|
On Tue, 29 Jan 2008 12:54:31 -0800, Timberwoof
<timberwoof.spam@inferNOnoSPAMsoft.com> wrote:
Quote: In article <13pur86stknrka9@corp.supernews.com>,
Skywise <into@oblivion.nothing.com> wrote:
Hatunen <hatunen@cox.net> wrote in
news:bppup39asup0fnqefnfsnq8p60hpf2gjno@4ax.com:
Simply make a prediction as to range, like "between 6.0 and 7.0",
or even "6.0 or greater" and then ruthlessly exclude anything
outside the range.
And what happens when a M5.9 or M7.1 quake strikes within the time
and location of the perdiction?
When rocket scientists present the expected landing areas of their space
craft, they give them in terms of probabilities: 90% within this
ellipse, 99% within this larger one, 99.99% on the planet somewhere...
Likewise, when astronomers predict impacts of asteroids on Mars, they
give likelihoods within target areas.
Indeed, mainstream geological predictions of earthquakes are along the
lines of "66% likelihood of an earthquake M6 or greater on the Hayward
fault in the next 33 years." (Not the actual prediction, but it makes
the point.)
Why not allow amateur predictors the same latitude? Still require time,
place, and magnitude but add the requirement of confidence intervals. So
a range would be predicted as M5±.5, 90%, ±1 10% If an earthquake occurs
meeting the other two criteria and is M5, that gives a 90% score for
magnitude ... but if it happened with M4.4 or M5.6, that would give only
a 10% score.
As I point out in my oher post, the problem is that earthquake
magnitudes are not given in linear terms. Not to mention that the
rocket scientists have good old consistent Newtonian mechanics to
base their calcs on and plain old distances, which are exprssed
linearly.
But earthqauke magnitudes are not linear and do not lend
themselves to such calculations. To do this, the magnitudes would
have to be given in linear terms, i.e., the actual energy of the
earthquakes. Then the energies could be converted back to M
numbers.
But I don't beleive any of our erstwhile predictors are using
actual probable energy levels for their methodology.
--
************* DAVE HATUNEN (hatunen@cox.net) *************
* Tucson Arizona, out where the cacti grow *
* My typos & mispellings are intentional copyright traps * |
|
|
| Back to top |
|
| Hatunen |
Posted: Tue Jan 29, 2008 5:21 pm |
|
|
|
Guest
|
On Tue, 29 Jan 2008 21:11:38 -0000, Skywise
<into@oblivion.nothing.com> wrote:
Quote: Hatunen <hatunen@cox.net> wrote in news:h4vup39v94ss97afurog12orv05giu6q75@
4ax.com:
On Tue, 29 Jan 2008 18:14:30 -0000, Skywise
into@oblivion.nothing.com> wrote:
Hatunen <hatunen@cox.net> wrote in
news:bppup39asup0fnqefnfsnq8p60hpf2gjno@4ax.com:
Simply make a prediction as to range, like "between 6.0 and 7.0",
or even "6.0 or greater" and then ruthlessly exclude anything
outside the range.
And what happens when a M5.9 or M7.1 quake strikes within the time
and location of the perdiction?
What does "ruthlessly" mean?
What if there's and M5.5? Or a M5.2? Should they count?
The predictor is free to make his bounds as loose or as tight as
he (or she) wishes, and if his method is any good he will be able
to set those bounds. If his method may lead to this sort of
result he/she needs to cover it, perhaps by explicitly defining
such deviations as may be acceptable. The important thing is
clear criteria which do not have to be fudged in any way, post
facto, to make the facts fit the theory.
My point was that, post facto, the predictor will try to claim
"close enough". And when you or I say "HEY!!! Not fair!", we
get dismissed with the usual ad hominems.
Well, of course. But close only counts in horseshoes and
handgrenades, as they say.
Quote: The issue here is that we need to make the effort to bring the
predictor and the evaluator to the same game. As it is now
the two sides are playing by different rules, which makes all
of this effort not much more than preaching to the choir, for
BOTH sides.
One problem is that it is so easy to toss around simple numbers
like 8.0 without accounting for what they really stand for. In my
example of "between 6.0 and 7.0" energy values of over thirty
times are being covered. Your example of 5.9 would be an
earthquake of something like one-third the energy of the 6.0.
If you were to say "5.0 to 7.0" then you are covering an energy
range of 1000:1. Any proper theory should be able to fit into a
range as wide as these. In fact, from a sort of common sense
standpoint, it would seem that any predictive theory should be
able to cover an energy release range of no more than, say, 10:1.
I'm not convinced that making an issue out of the logarithmic
scale will solve anything. The dynamic range of potential
earthquake energies is just too vast to work with linear
values.
Aye. And there's the problem all predictors face. The range is so
broad it makes hash of puny attempts to make magnitude
predictions like M5 to M6.
Quote: Furthermore, a prediction of "5-6" with a miss at 4.9 is off
by the same relative amount as a prediction of "7-8" with a
miss of 6.9. So what's the diff?
None really, but they're both misses.
What's needed is a clear explanation of the predictor's method,
though, before any further critique can be made.
--
************* DAVE HATUNEN (hatunen@cox.net) *************
* Tucson Arizona, out where the cacti grow *
* My typos & mispellings are intentional copyright traps * |
|
|
| Back to top |
|
| Skywise |
Posted: Tue Jan 29, 2008 5:34 pm |
|
|
|
Guest
|
Hatunen <hatunen@cox.net> wrote in news:vu5vp3t4a4rfvehuph691cr7mr1dqev7vl@
4ax.com:
Quote: Well, of course. But close only counts in horseshoes and
handgrenades, as they say.
And nuclear war? I've always added that one to the saying.
Quote: What's needed is a clear explanation of the predictor's method,
though, before any further critique can be made.
Agreed. Like I said, both predictor and evaluator must be on
the same game table playing by the same rules.
Brian
--
http://www.skywise711.com - Lasers, Seismology, Astronomy, Skepticism
Seismic FAQ: http://www.skywise711.com/SeismicFAQ/SeismicFAQ.html
Quake "predictions": http://www.skywise711.com/quakes/EQDB/index.html
Sed quis custodiet ipsos Custodes? |
|
|
| Back to top |
|
| Hatunen |
Posted: Tue Jan 29, 2008 5:53 pm |
|
|
|
Guest
|
On Tue, 29 Jan 2008 13:46:03 -0800 (PST), rogerh@lpbroadband.net
wrote:
Quote: On Jan 29, 2:34 pm, Skywise <i...@oblivion.nothing.com> wrote:
Hatunen <hatu...@cox.net> wrote in news:vu5vp3t4a4rfvehuph691cr7mr1dqev7vl@
4ax.com:
Well, of course. But close only counts in horseshoes and
handgrenades, as they say.
And nuclear war? I've always added that one to the saying.
What's needed is a clear explanation of the predictor's method,
though, before any further critique can be made.
Agreed. Like I said, both predictor and evaluator must be on
the same game table playing by the same rules.
LOL!
Nice in theory but impossible to achieve in reality. JOB will give
very specific rules but will then turn over rocks looking for ways to
get a hit. Especially where magnitude is concerned. He'll search the
world looking for the right number instead of sticking to one source.
Sure. But you're really just agreeing with Skywise.
--
************* DAVE HATUNEN (hatunen@cox.net) *************
* Tucson Arizona, out where the cacti grow *
* My typos & mispellings are intentional copyright traps * |
|
|
| Back to top |
|
| Timberwoof |
Posted: Tue Jan 29, 2008 6:01 pm |
|
|
|
Guest
|
In article <6l5vp3hqqd2sq24q0hp25vh168chgnjpi7@4ax.com>,
Hatunen <hatunen@cox.net> wrote:
Quote: On Tue, 29 Jan 2008 12:54:31 -0800, Timberwoof
timberwoof.spam@inferNOnoSPAMsoft.com> wrote:
In article <13pur86stknrka9@corp.supernews.com>,
Skywise <into@oblivion.nothing.com> wrote:
Hatunen <hatunen@cox.net> wrote in
news:bppup39asup0fnqefnfsnq8p60hpf2gjno@4ax.com:
Simply make a prediction as to range, like "between 6.0 and 7.0",
or even "6.0 or greater" and then ruthlessly exclude anything
outside the range.
And what happens when a M5.9 or M7.1 quake strikes within the time
and location of the perdiction?
When rocket scientists present the expected landing areas of their space
craft, they give them in terms of probabilities: 90% within this
ellipse, 99% within this larger one, 99.99% on the planet somewhere...
Likewise, when astronomers predict impacts of asteroids on Mars, they
give likelihoods within target areas.
Indeed, mainstream geological predictions of earthquakes are along the
lines of "66% likelihood of an earthquake M6 or greater on the Hayward
fault in the next 33 years." (Not the actual prediction, but it makes
the point.)
Why not allow amateur predictors the same latitude? Still require time,
place, and magnitude but add the requirement of confidence intervals. So
a range would be predicted as M5±.5, 90%, ±1 10% If an earthquake occurs
meeting the other two criteria and is M5, that gives a 90% score for
magnitude ... but if it happened with M4.4 or M5.6, that would give only
a 10% score.
As I point out in my oher post, the problem is that earthquake
magnitudes are not given in linear terms. Not to mention that the
rocket scientists have good old consistent Newtonian mechanics to
base their calcs on and plain old distances, which are exprssed
linearly.
But earthqauke magnitudes are not linear and do not lend
themselves to such calculations. To do this, the magnitudes would
have to be given in linear terms, i.e., the actual energy of the
earthquakes. Then the energies could be converted back to M
numbers.
But I don't beleive any of our erstwhile predictors are using
actual probable energy levels for their methodology.
I don't think many of them understand the concepts of an exponential
quantity like M, error bars, energy and work, or "methodology". So
debating about how to calculate and express errors in predicted
magnitudes is probably about as useful as Albert Schweitzer debating
differences in theology with the church that sponsored his trip to
Gabon. :-)
--
Timberwoof <me at timberwoof dot com> http://www.timberwoof.com
"When you post sewage, don't blame others for
emptying chamber pots in your direction." ‹Chris L. |
|
|
| Back to top |
|
| Timberwoof |
Posted: Tue Jan 29, 2008 6:07 pm |
|
|
|
Guest
|
In article <13pv5a08ncvcr38@corp.supernews.com>,
Skywise <into@oblivion.nothing.com> wrote:
Quote: Timberwoof <timberwoof.spam@inferNOnoSPAMsoft.com> wrote in
news:timberwoof.spam-F92627.12543129012008@nnrp-virt.nntp.sonic.net:
In article <13pur86stknrka9@corp.supernews.com>,
Skywise <into@oblivion.nothing.com> wrote:
Hatunen <hatunen@cox.net> wrote in
news:bppup39asup0fnqefnfsnq8p60hpf2gjno@4ax.com:
Simply make a prediction as to range, like "between 6.0 and 7.0",
or even "6.0 or greater" and then ruthlessly exclude anything
outside the range.
And what happens when a M5.9 or M7.1 quake strikes within the time
and location of the perdiction?
When rocket scientists present the expected landing areas of their space
craft, they give them in terms of probabilities: 90% within this
ellipse, 99% within this larger one, 99.99% on the planet somewhere...
Likewise, when astronomers predict impacts of asteroids on Mars, they
give likelihoods within target areas.
Snipola of rest
You make a good point, and I do think it can be done that way.
First, technically, how do we statistically analyse such
predictions to determine if they are better than chance, or not?
*every* prediction made by someone would have to be recorded and their
track record kept. Keeping the records would not be too hard; it would
be work to keep the database up-to-date.
Quote: But more importantly, and this is the deal breaker, even if
we do develop such a method of analysis, how do we get the
predictors to accept it? So many of them dismiss anything a
"scientist" has to say.
Hire a social engineer?
I suppose someone could write a bot that periodically came up with
"predictions" of earthquakes (by chance, of course) which were then
evaluated. Eventually, the track record of a random-number generator at
"predicting" earthquakes would become evident. Anyone claiming accuracy
in earthquake predictions would have to beat the computer.
--
Timberwoof <me at timberwoof dot com> http://www.timberwoof.com
"When you post sewage, don't blame others for
emptying chamber pots in your direction." ‹Chris L. |
|
|
| Back to top |
|
| JimLillie |
Posted: Tue Jan 29, 2008 7:50 pm |
|
|
|
Guest
|
Skywise wrote:
Quote: Hatunen <hatunen@cox.net> wrote in news:vu5vp3t4a4rfvehuph691cr7mr1dqev7vl@
4ax.com:
Well, of course. But close only counts in horseshoes and
handgrenades, as they say.
And nuclear war? I've always added that one to the saying.
Brian
CURLING - how could rockhounds forget Curling!
Jim ex- nuclear weapons tech -- SP5 69th Ord Co (Spec Wpns)
Now I predict that soon there will be a Mag 1.0 or greater earthquake
within a 1,000 mile radius of Petra. |
|
|
| Back to top |
|
| Guest |
Posted: Tue Jan 29, 2008 8:06 pm |
|
|
|
|
In article <13pv5a08ncvcr38@corp.supernews.com>,
Skywise <into@oblivion.nothing.com> wrote:
Quote: But more importantly, and this is the deal breaker, even if
we do develop such a method of analysis, how do we get the
predictors to accept it? So many of them dismiss anything a
"scientist" has to say.
I think you'll find that the only time the predictors will
accept a protocol is when it supports their "powers". The
"scientist" thing is just a symptom of a bigger problem. |
|
|
| Back to top |
|
| |
Page 4 of 4 Goto page Previous 1, 2, 3, 4
All times are GMT - 5 Hours
The time now is Sun Sep 07, 2008 10:24 pm
|
|