| Topic: |
Science > Physics |
| User: |
"Joe" |
| Date: |
05 Oct 2004 11:47:49 PM |
| Object: |
Entropy and Learning (like physics for example) |
When a person learns, for example [and especially!] physics, does
there entropy increase or decreas?
.
|
|
| User: "Sam Wormley" |
|
| Title: Re: Entropy and Learning (like physics for example) |
06 Oct 2004 11:53:17 AM |
|
|
Joe wrote:
When a person learns, for example [and especially!] physics, does
there entropy increase or decreas?
For the intellectual cripple, Joe:
http://scienceworld.wolfram.com/physics/Entropy.html
.
|
|
|
| User: "John Denker" |
|
| Title: Re: Entropy and Learning (like physics for example) |
06 Oct 2004 04:50:42 PM |
|
|
Joe asked:
When a person learns, for example [and especially!] physics, does
there entropy increase or decreas?
That's an interesting question. See below for answers.
Sam Wormley responded:
For the intellectual cripple, Joe:
http://scienceworld.wolfram.com/physics/Entropy.html
Yo, Sam, chill out!
That response is unduly personal, disrespectful, and non-responsive
to the question.
===========
To answer the question: In principle, the answer is "decrease".
However in practice, the decrease is sure to be lost in the noise
due to the immense complexity of the human organism.
To answer a slightly different version of the question: the concept
of entropy is used precisely and profitably in the analysis of
_machines_ that learn.
The introduction of the entropy idea into the neural-network learning
literature cleared up a number of mysteries.
J. Denker, D. Schwartz, B. Wittner, S.A. Solla, R. Howard,
L. Jackel and J. Hopfield
"Automatic learning, rule extraction, and generalization,"
Complex Systems 1, 877--922 (1987).
A more conveniently-accessible discussion of entropy in the context
of learning and information can be found at
http://www.av8n.com/physics/thermo-laws.htm#sec-entropy
The related concept of Vapnik-Chervonenkis Dimensionality also has
great utility. I get 6400 hits from:
http://www.google.com/search?q=Vapnik-Chervonenkis
.
|
|
|
| User: "Sam Wormley" |
|
| Title: Re: Entropy and Learning (like physics for example) |
06 Oct 2004 05:02:48 PM |
|
|
John Denker wrote:
Sam Wormley responded:
For the intellectual cripple, Joe:
http://scienceworld.wolfram.com/physics/Entropy.html
Yo, Sam, chill out!
That response is unduly personal, disrespectful, and non-responsive
to the question.
OK
.
|
|
|
| User: "Joe" |
|
| Title: Re: Entropy and Learning (like physics for example) |
07 Oct 2004 09:34:40 PM |
|
|
But he's right, I am an intellectual cripple!
.
|
|
|
|
|
|
|
| User: "Mark Martin" |
|
| Title: Re: Entropy and Learning (like physics for example) |
06 Oct 2004 08:09:49 AM |
|
|
Joe wrote:
When a person learns, for example [and especially!] physics, does
there entropy increase or decreas?
The entropy of a person's neuralnet might reasonably be expected to
decrease, due to the strengthened specificity of the information being
stored. But that comes by an investment of energy, which comes from the
world at large. As a person learns, the world's entropy is increased.
-Mark Martin
.
|
|
|
|
|
Related Articles |
Catholic Bishop: 9-11 Was Inside Job - Destroying America - I HATEbush just like any real man would - demand Justice for Humanity - Why wouldGOD will the destruction of life for a criminal thief? - We, as the People,demand you allow US, the human spe
Opto-Dynamic Surface Tension - or surface energy - dyne control for running plastic films or other substrates as like BOPP, LDPE, HDPE, PET, PP, PE, EVA, PTFE, etc.
Small request for those who are tired of people like eleaticus and retchier.
Supporters of True Evil - 'I'd like to see Americans enforce the lawof the land, and advocate the public execution of those responsible for
for education, is there a machine like overhead projector for photographs ???
time for USA & Europe to stop jawboning about Global Warming and DO SOMETHING-- like thistle seeding the atmosphere
Evidence for plate tectonics on Mars supports the idea on an early Mars ocean.[Re: New Map Provides More Evidence Mars Once Like Earth]
Saturn-like artifical debris rings a solution for global warming ?
| Re: I like cherries
Re: I like cherries
Re: I like cherries
Universe is shaped like a soccer ball
How to visualize a pdb-like file
Another circular definition: Like f = ma
Discovered: Most Earth-like planets yet
|
|
|
