Author Archives: red

A ramble about omniscience

1. I was talking a couple of weeks ago to a few friends from the glowfic community about whether it was logically consistent for a power to completely erase a concept from existence to also be able to guarantee that … Continue reading

Posted in Uncategorized | Leave a comment

Artificial Neural Networks

Of the many, many different ideas put forward to explain, model, and experiment with artificial cognition, one of the most practically successful is the Artificial Neural Network. Not because we’ve managed to actually create cognition with one, but because of … Continue reading

Posted in Computer Science, Machine Learning, Mathematics, Probability Theory | Tagged , , , , , , , , | Leave a comment

Bayesian Networks

I have mentioned before that Bayesian Inference is, in general, intractable. People like Gaussians a lot because many nice results in closed-form can be derived from them, analytical treatments are in general possible and even easy to do, but for … Continue reading

Posted in Computer Science, Machine Learning, Mathematics, Probability Theory | Tagged , , , , , , , | 1 Comment

Stopping rules, p-values, and the likelihood principle

A few months ago, someone who used to be called perversesheaf came to tumblr to bash LessWrong there. Now, while there is a very large number of criticisms that can be aimed at it, both as a website and community, … Continue reading

Posted in Mathematics, Probability Theory | Tagged , , , , , , , , , , , , , , , , , | 3 Comments

Confidence and Credibility

Three days ago I got slightly drunk with a few friends (two of which were mentioned in a recent post) and one of them and I were trying to explain to the other what the difference between confidence and credible intervals were. Since … Continue reading

Posted in Intuitive Mathematics, Mathematics, Probability Theory | Tagged , , , , , , , , , , , , | 3 Comments

Learning Bayes [part 3.5]

In part 3, I discussed the problem of finding a way of drawing a posterior point estimate of a number  based on a series of point estimates that’s more “theoretically valid” than taking the median, which is the standard of the … Continue reading

Posted in Mathematics, Probability Theory | Tagged , , , , , , , | 3 Comments

Learning Bayes [part 3]

I was talking to a friend (the same friend who inspired the two previous posts), who was talking to a friend of ours about a thing, and there’s a context but it doesn’t matter to what I want to write here. Suppose … Continue reading

Posted in Mathematics, Probability Theory | Tagged , , , , , , , , , , , , , | 2 Comments

An (Intuitive?) Introduction to Entropy

There’s a concept in Probability Theory called “entropy,” which borrows a bit from the physical concept of the same name. Intuitively, it’s the degree of “surprise” of an observation, or of a probability distribution. Alternatively, it’s how much information you gain … Continue reading

Posted in Mathematics, Probability Theory, Uncategorized | Tagged , , , , , , , | Leave a comment

Mathematical Hells

[Warning: Memetic hazard and philosophical trip. Also, probably incorrect. Talks about death and torture and robots.] The universe is probably infinite, flat, uniform, and ergodic. This means not only that there are an infinity of copies of the Earth, all … Continue reading

Posted in Mathematics, Philosophy | Tagged , , , , , , , , , | 5 Comments

Truth, Probability, and Unachievable Consistency

What is truth? Many an author has written lengthy philosophical treatises that begin with exactly this question, but, however shaky my identification with the group may be, as a rationalist my first and foremost answer to that question – or my … Continue reading

Posted in Mathematics, Probability Theory, Rationality | Tagged , , , , , , | 3 Comments