Hello all, I hope your semesters are going well! I am on spring break this week, so I’ve got a bit of time, and I figured instead of getting a head start on my homework for next week, I’d write a post on the blog! So last time, I talked about the Riesz representation theorem for Hilbert spaces, where we showed that for any Hilbert space , and that in fact (conjugate linear), which is in some sense the strongest form of reflexive we could ask for (this is what happens in finite dimensional spaces, for example). A natural question to ask, then, is just how nice do things actually get? I’ve remarked before that in finite dimensions, all norms are equivalent, all linear maps are continuous, and so up to an inner-product preserving map, there is only one normed space of dimension for each . We will, in fact, prove a much stronger generalization of this fact now.
Recall that, in linear algebra, a Hamel basis for a vector space is a maximal linearly independent set in . That is, a set is a Hamel basis given any , there exist unique scalars s.t. .
Examples: Let , i.e. the set of all sequences such that and let be the set of all sequences such that for all but finitely many . Let defined by if and if (so, for example, ), and let . Then . is a Hamel basis for , since given any , there is so that implies . It is clear and it is not hard to show this representation is unique. However, is not a Hamel basis for , since there is no finite subset of so that , where .
Of course, as Zach writes, every vector space possesses a Hamel basis, so there is some Hamel basis for the space above. A key part of the definition of a Hamel basis is that every element of is a finite linear combination of basis elements. Unfortunately, this makes Hamel bases not very useful for analysis, where we have the machinery to deal with infinite linear combinations. We would really like to be able to say that the set above is a basis for , morally it feels right. We want these sequence spaces to have “countable dimension”, but it’s not hard to show (as a corollary to the Baire Category Theorem) that in fact any complete normed space cannot contain a countable Hamel basis. To resolve this problem, we’ll pull a very typical mathematical trick, we’ll simply redefine what we mean by basis! I’ll make the following definition for a Hilbert space, and at the end of the post I’ll make some comments on generalizing the ideas to other Banach spaces.
Definition: Let be a Hilbert space. A set is called an orthonormal sequence if for all . We say the set is an orthonormal basis if it is an orthonormal sequence and for all , we have
where the sum on the right has only countably many non-zero terms and converges in the norm topology no matter how the terms are ordered.
Example: Let be as in the above example. If for we define , then it is easy to see that defines an inner product on , and is complete with respect to this inner product. The reader may easily verify that is an orthonormal basis for .
A quick comment: can we really define sums over uncountable indexing sets? The reader should try to prove that if we have any uncountable sum of real numbers , then either for at most countably many , or the sum is infinite. To avoid issues of defining convergence of arbitrary sums in arbitrary normed spaces, we essentially require that we deal with only sums containing only countably many non-zero terms, and of course we know how to talk about norm convergence of such sums. In fact, the following proposition will show that these are really the only situations we need to concern ourselves with.
Proposition Let be an orthonormal sequence in a Hilbert space . Then TFAE:
1) are an orthonormal basis for .
2) If for all , then .
3) Given any , we have .
The property 2) is called completeness and the equation in 3) is called Parseval’s identity. I’ll leave the proof to the reader; you may find it useful to use Bessel’s inequality, that state if is an ONS in , then for all , we have , and so in particular the set is countable. Okay, so now what do we do? Well, in linear algebra, one often defines a basis, then proceeds to show that every vector space has a basis and that any two bases of the space have the same cardinality, often called the dimension of the vector space. Then often one shows that two finite dimensional vector spaces are isomorphic if and only if they have the same dimension. Well, turns out that if we use our new definition of basis, we can get the same results for Hilbert spaces! Let’s first note that
Proposition Every Hilbert space has an orthonormal basis
Proof: Let be a Hilbert space and let denote the collection of all orthonormal sets in . If , then the result in trivial, otherwise contains a vector of unit norm. The set is trivially an ONS, so is non-empty. Partially order by inclusion. If is a linearly ordered subset of , then let . It is clear that if , then , and if , then there is so that (since is linearly ordered), so , and so indeed is an ONS. By Zorn’s lemma, there exists a maximal element in . Suppose for all . If , let . Then for all , and so the set is an ONS in containing , which contradicts the maximality of , so indeed we must have , which shows is complete, and hence is an ONB for .
This proof isn’t very tough, it’s very similar to the proof that every vector space has a basis, and is a pretty standard Zorn’s lemma argument. In fact, a lot of these proofs fall out nicely for Hilbert space cases. As I’ve hinted at, I’ll write a little bit (at some point) about how one can define bases for Banach spaces that admit countable linear combinations of elements. Unfortunately proofs don’t work so nicely in these cases, we really do need the nice geometry that is given by the complete inner product in a Hilbert space. I was going to write more for this post, but I just noticed it’s already pretty long, and we’re at a pretty nice place for a break. Next time, I’ll try to convince you that any two orthonormal bases for must have the same cardinality (so we can (well) define the dimension of ), and then show you that two Hilbert spaces are (unitarily) isomorphic if and only if they have the same dimension and then close by giving you my promised comments on bases in Banach spaces. Until then, good luck with any exams and homeworks you may have coming up!