Radial basis function
In mathematics a radial basis function (RBF) is a real-valued function whose value depends only on the distance between the input and some fixed point, either the origin, so that , or some other fixed point , called a center, so that . Any function that satisfies the property is a
Sums of radial basis functions are typically used to
Definition
A radial function is a function . When paired with a metric on a vector space a function is said to be a radial kernel centered at . A Radial function and the associated radial kernels are said to be radial basis functions if, for any set of nodes
- The kernels are linearly independent (for example in is not a radial basis function)
- The kernels form a basis for a Haar Space, meaning that the interpolation matrix
(1)
Examples
Commonly used types of radial basis functions include (writing and using to indicate a shape parameter that can be used to scale the input of the radial kernel[11]):
- Infinitely Smooth RBFs
These radial basis functions are from and are strictly positive definite functions[12] that require tuning a shape parameter
- Gaussian:
(2)
- Inverse quadratic:
(4)
- Inverse multiquadric:
(5)
- Gaussian:
- Polyharmonic spline:
(6)
- Thin plate spline (a special polyharmonic spline):
(7)
- Compactly Supported RBFs
These RBFs are compactly supported and thus are non-zero only within a radius of , and thus have sparse differentiation matrices
- Bump function:
(8)
- Bump function:
Approximation
Radial basis functions are typically used to build up function approximations of the form
|
(9)
|
where the approximating function is represented as a sum of radial basis functions, each associated with a different center , and weighted by an appropriate coefficient The weights can be estimated using the matrix methods of linear least squares, because the approximating function is linear in the weights .
Approximation schemes of this kind have been particularly used[
RBF Network
The sum
|
(10)
|
can also be interpreted as a rather simple single-layer type of
The approximant is differentiable with respect to the weights . The weights could thus be learned using any of the standard iterative methods for neural networks.
Using radial basis functions in this manner yields a reasonable interpolation approach provided that the fitting set has been chosen such that it covers the entire range systematically (equidistant data points are ideal). However, without a polynomial term that is orthogonal to the radial basis functions, estimates outside the fitting set tend to perform poorly.[citation needed]
RBFs for PDEs
Radial basis functions are used to approximate functions and so can be used to discretize and numerically solve Partial Differential Equations (PDEs). This was first done in 1990 by E. J. Kansa who developed the first RBF based numerical method. It is called the
|
(11)
|
The derivatives are approximated as such:
|
(12)
|
where are the number of points in the discretized domain, the dimension of the domain and the scalar coefficients that are unchanged by the differential operator.[13]
Different numerical methods based on Radial Basis Functions were developed thereafter. Some methods are the RBF-FD method,[14][15] the RBF-QR method[16] and the RBF-PUM method.[17]
See also
References
- ^ Radial Basis Function networks Archived 2014-04-23 at the Wayback Machine
- ^ Broomhead, David H.; Lowe, David (1988). "Multivariable Functional Interpolation and Adaptive Networks" (PDF). Complex Systems. 2: 321–355. Archived from the original (PDF) on 2014-07-14.
- S2CID 9500591.
- hdl:10919/36847.
Radial basis functions were first introduced by Powell to solve the real multivariate interpolation problem.
- ^ Broomhead & Lowe 1988, p. 347: "We would like to thank Professor M.J.D. Powell at the Department of Applied Mathematics and Theoretical Physics at Cambridge University for providing the initial stimulus for this work."
- ^ VanderPlas, Jake (6 May 2015). "Introduction to Support Vector Machines". [O'Reilly]. Retrieved 14 May 2015.
- OCLC 56352083.
- OCLC 1030746230.
- ISBN 9789812706331.
- ISBN 0521843359.
- ISBN 9789812706331.
- ISBN 9789812706331.
- ISSN 0898-1221.
- S2CID 121511032.
- ISSN 0045-7825.
- ISSN 1064-8275.
- S2CID 254691757.
Further reading
This article includes a list of general references, but it lacks sufficient corresponding inline citations. (June 2013) |
- Hardy, R.L. (1971). "Multiquadric equations of topography and other irregular surfaces". Journal of Geophysical Research. 76 (8): 1905–1915. .
- Hardy, R.L. (1990). "Theory and applications of the multiquadric-biharmonic method, 20 years of Discovery, 1968 1988". Comp. Math Applic. 19 (8/9): 163–208. .
- Press, WH; Teukolsky, SA; Vetterling, WT; Flannery, BP (2007), "Section 3.7.1. Radial Basis Function Interpolation", Numerical Recipes: The Art of Scientific Computing (3rd ed.), New York: Cambridge University Press, ISBN 978-0-521-88068-8
- Sirayanone, S., 1988, Comparative studies of kriging, multiquadric-biharmonic, and other methods for solving mineral resource problems, PhD. Dissertation, Dept. of Earth Sciences, Iowa State University, Ames, Iowa.
- Sirayanone, S.; Hardy, R.L. (1995). "The Multiquadric-biharmonic Method as Used for Mineral Resources, Meteorological, and Other Applications". Journal of Applied Sciences and Computations. 1: 437–475.