Given two metric spaces (X, dX) and (Y, dY), where dX denotes the metric on the set X and dY is the metric on set Y (for example, Y might be the set of real numbers R with the metric dY(x, y) = |x − y|, and X might be a subset of R), a function
is called Lipschitz continuous if there exists a real constant K ≥ 0 such that, for all x1 and x2 in X,
[1]
Any such K is referred to as a Lipschitz constant for the function ƒ.
Reference：http://en.wikipedia.org/wiki/Lipschitz_continuity
區分概念，Lipschitz Continuously Differentiable，見Nesterov’s Optimal Gradient Method(Yaoliang Yu的ppt第十頁)
[zz] 關于Lipschitz連續性的幾個例子 http://blog.sina.com.cn/s/blog_544a70700100fqix.html
1，f(x) = |x|
是Lipschitz連續的，Lipschitz常數為1，但是其不可微2，f(x) = x2
是Lipschitz不連續的，在無窮大處，f'(x)=2x,趨于無窮陡
3，f(x) = √x defined on [0, 1] is not Lipschitz continuous. This function becomes infinitely steep as x approaches 0 since its derivative becomes infinite.
4,The function f(x) = x3/2sin(1/x) (x ≠ 0) and f(0) = 0, restricted on [0, 1], gives an example of a function that is differentiable on a compact set while not locally Lipschitz because its derivative function is not bounded.
f'(x)=3/2√x sin(1/x)-cos(1/x)/√x
趨向于0的時候無界