Response surface methods based on kriging and radial basis function (RBF) interpolationhave been successfully applied to solve expensive, i.e. computationally costly,global black-box nonconvex optimization problems.In this paper we describe extensions of these methods to handle linear, nonlinear, and integer constraints. In particular, algorithms for standard RBF and the new adaptive RBF (ARBF) aredescribed. Note, however, while the objective function may be expensive, we assume that any nonlinear constraints are either inexpensive or are incorporated into the objective function via penalty terms. Test results are presented on standard test problems, both nonconvexproblems with linear and nonlinear constraints, and mixed-integernonlinear problems (MINLP). Solvers in the TOMLAB OptimizationEnvironment (http://tomopt.com/tomlab/) have been compared,specifically the three deterministic derivative-free solversrbfSolve, ARBFMIP and EGO with three derivative-based mixed-integernonlinear solvers, OQNLP, MINLPBB and MISQP, as well as the GENOsolver implementing a stochastic genetic algorithm. Results showthat the deterministic derivative-free methods compare well with thederivative-based ones, but the stochastic genetic algorithm solver isseveral orders of magnitude too slow for practical use.When the objective function for the test problems is costly to evaluate, the performance of the ARBF algorithm proves to be superior.