I want to know how can i call one FEM(like ansys)software from Matlab(optimization toolbar) and how can i make inputs and outputs beetween these two(making a loop until reaching the optimum result)
One way is to pass data by files on the OS and invoke your application through a MATLAB OS call. The bang operator (!) will invoke the OS and pass any command you place after it to the OS. FOr DOS you can also use dos( callAnsys() )