Wavelet Frames Generated by Bandpass Prolate Functions Jeffrey A. Hogan Joseph D. Lakey School of Mathematical and Physical Sciences University of Newcastle Callaghan NSW 2308 Australia Email: jeff.hogan@newcastle.edu.au Department of Mathematical Sciences New Mexico State University Las Cruces, NM 88003–8001, USA Email: jlakey@nmsu.edu Abstract—We refer to eigenfunctions of the kernel corresponding to truncation in a time interval followed by truncation in a frequency band as bandpass prolates (BPPs). We prove frame bounds for certain families of shifts of bandpass prolates, and we numerically construct dual frames for finite dimensional analogues. In the continuous case, the corresponding families produce wavelet frames for the space of square-integrable functions. I. I NTRODUCTION For T > 0 and Ω > 0 fixed, denote by QT the operator that multiplies f ∈ L2 (R) by 1[−T,T ] and set PΩ = F −1 QΩ/2 F R∞ where (Ff )(ξ) = fb(ξ) = −∞ f (t)e−2πitξ dt denotes the Fourier transform. Abbreviate Q = Q1 . The eigenfunctions of PΩ Q are the (zero order) prolate spheroidal wave functions, e.g., [1]. When ordered by the eigenvalues of PΩ Q, which is compact and self-adjoint, the prolate ϕn (t) has n zeros in [−1, 1]. The sequence {ϕn } forms an orthonormal basis for the Paley–Wiener space PWΩ = {PΩ f : f ∈ L2 (R)}, and is a complete orthogonal family in L2 [−1, 1]. More generally, (abusing notation slightly) one can define (QS f )(t) = f (t) 1S (t) and PΣ f = (QΣ fb)∨ where f and Σ are measurable. When S and Σ are both compact, PΣ QS is compact and it is self-adjoint on PWΣ = {PΣ f : f ∈ 2 L R (R)}. The operator PΣ QS is given by (PΣ QS f )(t) = ρ (t − s) f (s) ds where ρbΣ = 1Σ . We will be particularly S Σ interested in the case in which Σ = {ξ : Ω0 ≤ |ξ| ≤ Ω}. In this case we denote the corresponding operator PΣ by PΩ0 ,Ω = P2Ω − P2Ω0 . The following is a special case of a more general fact observed by Slepian and Pollak [2, (9) and p. 59] for symmetric kernels. Theorem 1: The eigenfunctions of PΩ0 ,Ω Q form an orthonormal basis for PWΩ0 ,Ω . Their restrictions to [−1, 1] a complete orthogonal family in L2 [−1, 1] with Rform 1 |ψ(t)|2 dt = λ when PΩ0 ,Ω Qψ = λψ. −1 The eigenvalues of PΩ0 ,Ω Q are not necessarily nondegenerate, as are those of PΩ Q. However, just as with baseband prolate eigenfunctions of PΩ Q, the eigenfunctions of PΩ0 ,Ω Q can be taken as either symmetric or antisymmetric and we index them as ψn where ψ2n is even and ψ2n+1 is odd, and their eigenvalues λn satisfy λn+2 ≤ λn . In what follows we are interested in frames for PWΩ0 ,Ω generated by shifting the first several eigenfunctions. We are ultimately interested in using prolates to analyze discrete sample data. As such, we consider bandpass analogues of finite dimensional versions of the prolates. The finite dimensional analogue of PWΩ0 ,Ω is the space of (K 0 , K)-bandlimited vectors in CN whose discrete Fourier transforms are supported in frequencies between K 0 and K (mod N ). The baseband prolate theory for this case was originally worked out by Chamzas and Xu [3]; see also [1, pp. 32-33], which also discusses other contributions to the finite theory. Fix a finite dimension N and think of vectors x = [x(0), . . . , x(N − 1)]T ∈ CN = `2 (ZN ) as one period of a periodic sequence. Fix K such that 2K + 1 ≤ N . Define the Toeplitz matrix A = AK with Ak` = ak−` = sin ((2K + 1)(k − `)π/N )/(N sin((k − `)π/N ), k, ` = 0, . . . , N − 1. Vectors in the image of A are said to be K-bandlimited, as the DFTs of the columns of A vanish at indices m ∈ ZN such that m > K mod N (or |m| > K when index values are taken in −N/2, . . . , N/2, N even). Denote by AM = AK M the principal M × M minor of A and consider the eigenproblem AM s = λs, s = [s(0), . . . , s(M − 1)]T which can be regarded as a finite dimensional analogue of the problem QPΩ Qϕ = λQϕ. In [3] it is proved that when M + 2K < N and M > 2K, as we will assume here, the ordered eigenvalues λn of AM satisfy 1 > λ0 > λ1 > · · · > λ2K , that is, they are nondegenerate. Also, λ2K+1 = · · · = λM −1 = 0, which follows from the fact that the range of AK has dimension 2K + 1. When M + 2K ≥ N one will have some eigenvalues equal to one (loc. cit.). On the other hand, one can ask which, and how many, eigenvalues can be close to one (when M + 2K < N ). Here it is possible to argue as in [4] that the number of eigenvalues larger than 1/2 cannot exceed the normalized time–bandwidth product defined as (2K + 1) × M/N . Direct numerical eigenspace decomposition of AM is problematic for large M and K. However, AM commutes with the symmetric tridiagonal matrix TM defined by π π Tkk = − cos (2k + 1 − M ) cos (2K + 1), N N Tk,k+1 = sin π π(k + 1) sin (M −1−k), N N k = 0, . . . , M −1 and Tk−1,k = Tk,k+1 and Tk` = 0 if |k − `| > 1. Finite prolate (FPS) sequences sn = [sn (0), . . . , sn (M − 1)]T , n = 0, . . . , 2K can readily be computed as eigenvectors of TM corresponding to the nonzero eigenvalues of AK M . Extensions to `2 (ZN ) are obtained by applying the N ×N Toeplitz matrix A to the vectors [sn (0), . . . , sn (M − 1), 0, . . . , 0] ∈ CN . These extensions lie in the space of K-bandlimited vectors. They posses the same double orthogonality properties of the baseband prolates and form a complete family for the space of K-bandlimited vectors. II. E IGENFUNCTIONS OF TIME AND FREQUENCY LIMITING In this section we prove a general identity for eigenfunctions of operators of the form PΣ QS where QS denotes multiplication by 1S and PΣ = F −1 QΣ F. We assume that S and Σ are compact and that Σ = −Σ. The latter implies that the kernel of PΣ is real and symmetric. That PΣ QS is selfadjoint on PWΣ , PΣ is a projection on PWΣ and QS is a projection on L2 (R) whose range has zero intersection with that of PΣ then imply that the eigenvalues {λn } of PΣ QS satisfy 1 > λ0 ≥ λ1 ≥ · · · > 0. Lemma 2: Under the conditions above, the restrictions to S of the eigenfunctions ψn of PΣ QS , normalized to kψn kL2 (R) = 1, form a complete orthogonal family in L2 (S). P In addition, λn |ψbn (ξ)|2 = |S|, ξ ∈ Σ. Proof 1 (of Lemma 2): Completeness and orthogonality follow from arguments in Slepian and Pollak [2]. In particular, orthogonality in L2 (S) follows from symmetry of the kernel of PΣ , cf., [2, (20) and p. 59]. Now one has X X 1 |(PΣ QS ψ n )∧ (ξ)|2 λn |ψbn (ξ)|2 = λn Z Z ∞ X 1 = 1Σ (ξ) ψn (t) e−2πitξ dt ψn (s) e2πisξ ds λ S S n=0 n Z X Z ∞ 1 = 1Σ (ξ) e2πisξ ψ n (s) ds ψn (t) e−2πitξ dt λn S S Z n=0 Z 2πitξ −2πitξ = 1Σ (ξ) e e dt = 1Σ (ξ) 1S = 1Σ (ξ) |S| . S Here used the orthonormal expansion e2πitξ = P 1 we2πi·ξ he , ψn iL2 (S) ψn (t) of the exponential in L2 (S) for n λn P ξ ∈ Σ. Thus λn |ψbn (ξ)|2 = |S| on Σ. 0 When Σ = {Ω ≤ |ξ| ≤ Ω} and S = [−1, 1] the convergence can be shown to be uniform in ξ. Details will be provided elsewhere. An illustration of the corresponding fact for standard prolates is foundPin [5]. As such, given A < |S| there is N an N such that A ≤ n=0 λn |ψbn (ξ)|2 ≤ |S| for all ξ ∈ Σ. We now specialize to the case in which S = [−1, 1] and Σ = {ξ : Ω0 ≤ |ξ| ≤ Ω}, letting {ψn } be a complete set of eigenfunctions of PΩ0 ,Ω Q with kψn k = 1. Recall that a family {fn } in a Hilbert space H is a frame for H if there are constants 0 < A ≤ B < ∞ such that for each x ∈ H, X Akxk2H ≤ |hx, fn i|2 ≤ Bkxk2H . n The frame is tight if one can√take A = B. ∞,∞ Theorem 3: The family { λn ψn (t − k/(2Ω))}n=0,k=−∞ forms a tight frame for PWΩ0 ,Ω with bound 4Ω. Proof 2 (of Theorem 3): The bandpass prolates ψn are concentrated in [−1, 1] and frequency supported in Ω0 < |ξ| < Ω. Using Plancherel’s theorem we have ∞ D XX p ` E2 f, λn ψn · − 2Ω ` n=0 ∞ D E2 XX = λn fb, eπi` ·/Ω ψbn (·) n=0 ` = ∞ XX ` Z λn 2 fb(ξ) e−πi`ξ/Ω ψbn (ξ) dξ −Ω n=0 = 2Ω Ω ∞ X Z Ω λn fb(ξ) ψbn (ξ)2 dξ −Ω n=0 Ω Z |fb(ξ)|2 = 2Ω −Ω ∞ X 2 λn ψbn (ξ) dξ n=0 Z Ω = 4Ω −Ω |fb(ξ)|2 = 4Ω Z Ω0 <|ξ|<Ω |fb(ξ)|2 where we have used the fact that if S = [−1, 1] then |S| = 2 in Lemma 2 and that f ∈ PWΩ0 ,Ω , that is, fb(ξ) = 0 unless Ω0 < |ξ| < Ω. In [5] the corresponding √ tight frame property was proved for the baseband prolates { λn ϕn }, so Theorem 3 is an extension of that result to the case of bandpass prolates. However, the frame bound here depends solely on Ω and not on Ω0 . In a sense, the frame is more redundant Ω0 → Ω. As in [5], the PN −1 as b 2 0 monotone convergence of n=0 λn |ψn (ξ)| to 2 on Ω < |ξ| < Ω implies the following corollary of Lemma√2. Corollary 4: For N sufficiently large, the shifts { λn ψn (t− N −1,∞ k/(2Ω))}n=0,k=−∞ form a (non-tight) frame for PWΩ0 ,Ω . III. F INITE DIMENSIONAL BANDPASS PROLATES In this section we discuss how to construct numerically bandpass prolates for the finite dimensional analogue of PWΩ0 ,Ω , namely, the space of (K 0 , K)-bandlimited vectors in CN whose discrete Fourier transforms are supported in frequencies between K 0 and K (mod N ). Numerically computed bandpass prolates were used in [6] to study synchrony in sampled EEG signals. Here we numerically compute finite dimensional bandpass prolates (FBPs). In this setting it is possible to compute numerically the canonical dual elements for frames generated by certain shifted FBPs. For K 0 < K we regard the (K 0 , K)-bandpass prolates concentrated in CM as particular elements of the span of the M -concentrated and K-bandlimited finite prolates that happen to be orthogonal to the M -concentrated and K 0 -bandlimited prolates. In the continuous case, the (Ω0 , Ω) bandpass prolates are defined as eigenfunctions of (PΩ − PΩ0 )Q. We then define the M -concentrated and (K 0 , K)-bandlimited finite dimensional bandpass prolates as the unique K-bandlimited K0 extensions to CN of the eigenvectors of AK M − AM . In turn, these eigenvectors can be expressed in terms of their coefficients when expanded in eigenvectors of AK M. Lemma 5: Let sn (M, K) denote the nth eigenvector of K0 AK Let σ be an eigenvector of AK M , 0 ≤ n ≤ 2K. P M − AM expressed as σ = n αn sn (M, K). Then the coefficients α = [α0 , . . . , α2K ]T of σ form an eigenvector of the matrix ΛK − T T (M, K, K 0 ) where ΛK is the diagonal matrix whose entries are the nonzero eigenvalues of AK M and 0 T (T (M, K, K 0 ))k,` = AK s (M, K) s (M, K), 0 ≤ k, ` ≤ ` M k 2K. P2K Proof 3 (of Lemma 5): Let x = n=0 αn sn (M, K). Then 0 0 K K K (AK M − AM )x = (AM − AM ) = 2K X 2K X αn sn (M, K) n=0 2K X λn αn sn (M, K) − n=0 20 40 60 80 100 120 20 40 60 80 100 120 20 40 60 80 100 120 20 40 60 80 100 120 0.2 0 -0.2 0.2 0 -0.2 0.2 0 -0.2 0 αn AK M sn (M, K) . n=0 0 Since the range of AK is contained in that of AK and the vectors {sn (M, K)}, 0 ≤ n ≤ 2K extend uniquely to a basis range of AK , one can write P for Kthe 0 K0 sn (M, K) = k hAM sn (M, K), sk (M, K)i sk (M, K) AMP 0 T = the sums k (T (M, K, K ) )n,k sk (M, K). Rearranging P one finds that the coefficients βn of βn sn (M, K) = n K0 (AK M − AM )x are given by K 0.2 0 -0.2 0 T β = (Λ − T (M, K, K ) )α where α = [α0 , . . . , α2K ]. In particular, if x is an eigenK0 vector of AK M − AM then the coefficient vector α of x in the basis {sn (M, K)} is an eigenvector of the matrix ΛK − T (M, K, K 0 )T . IV. N UMERICAL FBP S AND SHIFT FRAMES Theorem 3 really says that shifts of all BPPs by multiples of two over the time–bandwidth product result in a tight frame for PWΩ0 ,Ω , though the frame has infinite redundancy. In that case, the number of shifts per unit duration (D = 2) is equal to the time–bandwidth product. Shifting at any integer multiple of this rate also results in a tight frame in the continuous case. In the FBP case, the analogous result is that taking 2KM/N shifts by multiples of N/(2K) of each FBP per unit duration M results in a tight frame. As the space of (K 0 , K)bandlimited vectors has dimension 2(K − K 0 ), using all 2K of the shifts of 2(K − K 0 ) independent FBPs would result in a frame having redundancy 2K. In [5] we proved that one can still obtain non-tight baseband prolate-shift frames for PWΩ by shifting each of the first several prolates at a lower rate, with the minimal rate needed for a (nonredundant) Riesz basis being one prolate shift per unit time–bandwidth per unit time, cf., also [7]. Any higher rate results in a redundant frame. The motivation was that, in contrast to expansions in shifted sinc functions, most of the energy of a bandlimited signal over a given duration could be captured in terms of the prolate shifts most concentrated in that duration. In what follows we will illustrate this point numerically for bandpass prolates in the finite setting. Figure 1 illustrates the first several FBPs and their shifts in the particular case N = 128, M = 64, K = 16, K 0 = 8 using the four most concentrated FBP generators. Fig. 1. Eigenvectors corresponding to the four largest eigenvalues of (AK M− 0 0 = 8. The first plot also shows AK ) for N = 128, M = 64, K = 16 and K M a circular shift of the first FBP. The normalized time–bandwidth product and the number of eigenvalues larger than 1/2 in this case is 8. The eigenvalues for the four modes plotted are each at least 0.998. 4 2 0 20 40 60 80 100 120 20 40 60 80 100 120 20 40 60 80 100 120 20 40 60 80 100 120 4 2 0 4 2 4 2 Fig. 2. Moduli of the centered DFTs of the 128-point FBPs plotted in Fig. 1. V. BANDPASS WAVELET FRAMES Walter and Shen [7] proposed use of a cosine-modulate of the first baseband prolate as a generator of a wavelet frame. Besides not being optimally localized compared to bandpass prolates, using a single generator does not provide as much frequency resolution as using the first several bandpass prolates. When Ω = 2Ω0 , a 1/Ω-dilated BPP has Fourier support 1/2 ≤ |ξ| ≤ 1 and is time-concentrated in [−Ω, Ω]. As indicated in the discussion following Theorem 3, the shifts by multiples of 1/(2Ω) of the first several dilated BPPs D1/Ω ψn (t) = √1Ω ψn Ωt will then form a frame for PW1/2,1 Ω of functions of the form {ψn,k (t) = ψnΩ (t − k/2) : k ∈ Z, n = 0, . . . , N − 1} where ψnΩ = D1/Ω ψn . By the same token, the dilates by 2j of ψnΩ are frequency supported in 2−j−1 ≤ 2−j and their translates by half-integers will form a frame for PW2−j−1 ,2−j . Since the union of these multiresolution spaces is dense in L2 (R), it follows that the functions Ω = 2j/2 ψn (2j t − k/2), j, k ∈ Z, n = 0, . . . N − 1 ψn,j,k form a wavelet frame for L2 (R) when N is sufficiently large. 0.1 0 -0.1 20 40 60 80 100 120 0.1 0 -0.1 0.05 0 -0.05 20 40 60 80 100 120 20 40 60 80 100 120 20 40 60 80 100 120 4 20 40 60 80 100 120 0.2 0 -0.2 2 0 20 40 60 80 100 120 20 40 60 80 100 120 0.2 0 -0.2 Fig. 3. Dual frame generators for the frame generators plotted in Fig. 1. The FBP frame for the bandpass space consists of eight circular shifts by multiples of 16 of the four generators, and the duals are shifts by the same amount of the dual generators. The number of frame shifts is 4 × 8 = 32 whereas the dimension of the bandpass space is 16, so the redundancy factor is two. The dual generators were computed numerically up to a pointwise error of 10−6 by applying the frame conjugate gradient method [8], [9] to the FBP generators. The duals are not as concentrated within M -points of the center as are the primal generators, although dual generators tend to be better localized when there is more redundancy (not shown). 1.5 1 0.5 20 40 60 80 100 120 1.5 1 0.5 4 2 0 -2 ×10-16 Fig. 5. Frame reconstruction of a bandpass vector using the FBP-shift frame corresponding to N = 128, M = 64, K = 16 and K 0 = 8, with the first four FBPs each shifted by multiples of 16 units. The first plot shows the real (solid) and imaginary (dash-dot) parts of a signal obtained by randomly generating DFT values from a uniform distribution in [0, 1] supported in the (K 0 , K)-band. The second plot shows the DFT values (solid) plotted under the DFT modulus of the first FBP. The third plot shows the reconstruction error when coefficients of the FBP shifts are taken as inner products with corresponding shifts of the dual frame generators. The relative pointwise error is on the order of 10−14 , consistent with the precision imposed in estimating the dual frame generators. bandwidth–of the first few BPPs that would then generate a wavelet Riesz basis for L2 (R). R EFERENCES 20 40 60 80 100 120 20 40 60 80 100 120 20 40 60 80 100 120 5 4 3 2 1 5 4 3 2 1 Fig. 4. Centered DFT moduli of the dual frame generators plotted in Fig. 3. Orthogonality across scales follows simply from Plancherel’s theorem and the fact that dilates of the BPPs by different powers of two have disjoint frequency supports. Typically such a wavelet frame will be redundant and not tight. Nonetheless, the two-scale dilates of the BPP-shift dual frame for PW1/2,1 will form a dual frame for L2 (R), so frame expansions are not complicated once the duals are computed. VI. C ONCLUSION We have established frame bounds for certain bandpass prolate shift families, numerically generated such frames with low redundancy for the analogous finite dimensional case, and outlined a method to generate wavelet frames by dilating and translating the first several (most concentrated) bandpass prolates. It is an open problem to prove frame bounds for nonredundant families of shifts–one per unit time per unit time– [1] J. Hogan and J. Lakey, Duration and Bandwidth Limiting. Prolate Functions, Sampling, and Applications. Boston, MA: Birkhäuser, 2012. [2] D. Slepian and H. Pollak, “Prolate spheroidal wave functions, Fourier analysis and uncertainty. I,” Bell System Tech. J., vol. 40, pp. 43–63, 1961. [3] W. Xu and C. Chamzas, “On the periodic discrete prolate spheroidal sequences,” SIAM J. Appl. Math., vol. 44, pp. 1210–1217, 1984. [4] H. Landau, “On the density of phase-space expansions,” IEEE Trans. Inform. Theory, vol. 39, pp. 1152–1156, 1993. [5] J. Hogan and J. Lakey, “Frame properties of shifts of prolate spheroidal wave functions,” Appl. Comput. Harmonic Anal., 2014, http://dx.doi.org/10.1016/j.acha.2014.08.003. [6] J. Hogan, J. Kroger, and J. Lakey, “Time and bandpass limiting and an application to EEG,” Sampling Thy. Signal Image Process., vol. 13, pp. 296–313, 2014. [7] G. Walter and X. Shen, “Wavelets based on prolate spheroidal wave functions,” J. Fourier Anal. Appl., vol. 10, pp. 1–26, 2004. [8] K. Gröchenig, “Acceleration of the frame algorithm,” IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3331–3340, Dec 1993. [9] P. Casazza, G. Kutyniok, and F. Philipp, “Introduction to finite frame theory,” in Finite Frames, ser. Appl. Numer. Harmon. Anal. Birkhäuser/Springer, New York, 2013, pp. 1–53.