The selection of hyperparameters and circuit components for optimum hardware implementation of a neural network is a challenging task, which has not been automated yet. This work proposes the method for the selection of optimum neural network architecture and hyperparameters using genetic algorithm based on the hardware-related performance metrics, such an on-chip area, power consumption, processing time and robustness to hardware non-idealities, and focus on memristor-based analog network architecture. The experimental results show that the proposed approach allows to select the optimum architecture based on the designers' preferences.