Returning to
For example, when the difference between the weight W′N×V that is the parameter before the update of the weight W′N×V and the weight W′N×V that is the parameter after the update of the weight W′N×V is smaller than a threshold, the learning termination determining section 15 terminates the learning. The weight W′N×V before the update is a value upon the termination of the activation of the parameter adjusting section 13 or upon the start of the activation of the adjusted parameter distributed representation learning section 14. The weight W′N×V after the update is a value upon the termination of the activation of the parameter distributed representation learning section 14. A requirement for the termination of the learning is expressed by the following Inequality (1). W′N×Vnew is W′N×V after the update of W′N×V. W′N×Vold is W′N×V before the update of W′N×V. ε is a threshold. It is sufficient if the difference between the weight W′N×V before the update and the weight W′N×V after the update is determined to be sufficiently small based on the threshold. W′N×Vnew?W′N×Vold<ε??(1)
When the difference between the weight W′N×V before the update and the weight W′N×V after the update is equal to or larger than the threshold, the learning termination determining section 15 causes the parameter adjusting section 13 and the adjusted parameter distributed representation learning section 14 to repeatedly operate.