Non-programmed gait generation of quadruped robot using pulse-type hardware neuron models

In this paper, the authors will propose the active gait generation of a quadruped robot. The theory that quadruped animals unconsciously generate gaits by some system based on neural networks in the spinal cord is widely accepted. However, how biological neurons or neural networks can generate gaits is not clear. To clarify the gait generation method, one of the solutions is using the neuron model similar to the biological neuron. We developed the quadruped robot system using self-inhibited pulse-type hardware neuron models (P-HNMs), which can output the electrical activity similar to those of biological neurons. The P-HNMs consist of the cell body model and the inhibitory synaptic model. The cell body model periodically outputs pulsed voltages; the inhibitory synaptic model inhibits the pulsed voltages. The pulse period can change by varying the synaptic weight control voltage applied to the P-HNMs. We varied the synaptic weight control voltage according to the pressure on the robot’s toes. Also, we changed the angle of the robot’s joints by a constant angle each time the P-HNMs output a pulse. As a result of the walking experiment, we confirmed that the robot generates walk gait and trot gait according to the moving speed. Also, we clarified the process by which the robot actively generates gaits from the upright state. These results show that animals may not use many biological neurons to generate gaits. Furthermore, the results suggest the possibility of realizing simple and bio-inspired robot control.


Introduction
Quadruped animals change the gait according to the locomotion speed by adjusting leg movements [1].The experiments using decerebrated cats show that gaits generated were unconsciously by some systems based on neural networks in the spinal cord [2][3][4].Thus, implementing the gait generation mechanism of animals on a walking robot will allow the active gait generation with a simple control system.There are various studies for elucidating the mechanism by which animals gait generation method [5,6].However, the information processing of biological neurons is difficult to analyze.Therefore, research has been conducted to estimate the gait generation mechanism using robots.
Research using a biped machine with passive joints revealed that a gait pattern was generated without a control mechanism when the biped machine was placed on a shallow slope [7].Also, research using a quadruped machine revealed that the gait of a quadruped animal was generated according to the type of body joints and the slope angle [8].Furthermore, gaits can generate even if the number of legs increased to six or more [9].These experiments suggest that gaits can be generated without a control mechanism even with machines.However, to realize a robot that can actively walk, it is necessary to study the gait generation mechanism including the driving method of the actuator.
Recently, a quadruped robot with joint using servomotors controlled by decoupled mathematical oscillating models based on the active rotator model has been proposed [10,11].The quadruped robot could generate an animal's gait according to the pressure on the quadruped's feet.Also, it has clarified that another robot controlled in the same method could switch the gaits according to its moving speed [12].These results suggest the effectiveness of using the difference in pressure on each foot to generate gait.However, the oscillators used to control the joints were not designed on a biological basis.The authors think that spike firing has a significant role in information processing in the brain.
The authors are studying robot control using pulse-type hardware neuron models (P-HNMs).The P-HNMs can output the spike firing (action potential) similar to a biological neuron [13].Our research aims to develop a simple and efficient control method for robots using the artificial motor nervous system and central nervous systems.Therefore, hardware implementation will be advantageous in a largescale network system.
Previously, we have developed a quadruped robot system that implemented a gait generation mechanism using P-HNMs.The mechanism is similar to the peripheral nervous system in that independent P-HNMs control each limb individually.Also, we revealed that the robot system generates two kinds of gaits depending on the moving speed [14].However, the process by which gaits generated is not clear.In this paper, the authors improved the quadruped robot to analyze how the gaits generated by the method we proposed.First, we will introduce the components of our quadruped robot system.Second, we will discuss the gait generation method, and finally, we will show the experimental result.

Quadruped robot system
Figure 1 shows our constructed quadruped robot system.This chapter describes the individual components of the quadruped robot system.

Mechanical and electrical components
The quadruped robot consists of mechanical and electrical components.The mechanical components of the robot system consist of the body frame and four legs.The body frame was made from an aluminum alloy (A5052).Some parts of the legs were made from polylactic acid (PLA).The robot's leg length is 138 mm, the distance between the front and rear legs is 170 mm, and the distance between the left and right legs is 101 mm.The total weight of the robot is approximately 1.1 kg.This robot has no degrees of freedom except for legs to focus on the gait generation using the pressure underside of the foot.All the legs have the same structure, where the legs have two joints on the same axis using servomotors (Kondo Kagaku: KRS-2552).
The electrical components of the robot system consist of circuit boards of self-inhibited P-HNM, pressure sensors (Interlink Electronics: FSR402), single-board microcontroller (Arduino DUE), and peripheral circuit board.The pressure sensors have attached to the feet.Also, we mounted a battery and Bluetooth module.Therefore, we were able to proceed with the walking experiment of the robot system without physical connections for power supply and communication.

Leg controlling system
We set two commands in the microcontroller to move the legs.One is to read the output of the pressure sensor and output the voltage accordingly.The other is to change the angle of the servomotors by a constant angle each time the voltage input to the interrupt pin exceeds 1.7 V (microcontroller's interruption voltage).When changing the angle of servomotors, the foot passes through the four target points and moves along the trajectory shown in Fig. 2. We set the microcontroller to process these commands individually for four legs.Figure 4 shows the simulation result of waveform output by self-inhibited P-HNM.We changed v w applied to Figure 5 shows the result of the measured relation between the pulse period T and the synaptic weight control voltage v w of the self-inhibited P-HNM.The curve in Fig. 5 is the result of approximating the plotted points with a second-order polynomial, the region we used to control the robot.

Connection of components
We connected these components to realize the quadruped robot system with active gait generating function.Figure 6 shows the connection of the single-leg components and circuit diagram of the peripheral circuit.The peripheral circuit includes a low-pass filter, buffer and voltage dividing circuits.The low-pass filter consists of a resistor R F and a capacitor C F .The buffers consist of operational amplifier U 1 and U 2 .The voltage dividing circuits consist of R D1 , We input the PWM output of the microcontroller to the circuit board of self-inhibited P-HNM as an analog output through the low-pass filter of the peripheral circuits.The voltage output by the circuit board of self-inhibited P-HNM applied to the microcontroller's interrupt pin through the peripheral circuit.Thus, we allowed the robot system to change the speed at which each leg moves in real time.Each leg moves by a constant angle each time the circuit boards of self-inhibited P-HNM output a pulse, and the period at which the P-HNMs output a pulse varies depending on the pressure.Therefore, the speed at which each leg of the robot moves varies depending on the pressure on the feet.

Gait generation method
The following equations express the relation between the speed of moving legs and the pressure on the feet.The microcontroller controlled the legs individually.Therefore, some parameters are different for each leg.In the following equations, the subscript "i" means the parameter for the ith leg.The angular velocity of moving legs ω i can be described as the following equation: where θ is an actuation angle of servomotors each time the circuit board of self-inhibited P-HNM output a pulse.The synaptic weight control voltage v w applied to the circuit board of self-inhibited P-HNM can be described as the following equation: where v pressi is the applied voltage to the microcontroller depending on output by the pressure sensors.σ is a constant for converting v pressi to v wi , and represents the effect of pressure.From the approximate formula in Fig. 5, the pulse period T i of the output voltage of self-inhibited P-HNMs v out can be described as the following equation: From these equations, ω i can describe as the following equation.This equation indicates that the pressure on the foot reduces the angular velocity of moving the leg. (1 wi − 8.0v wi + 3.9. (4) i = 5.0v 2 wi − 8.0v wi + 3.9 .

Experimental result
To analyze the gaits generated by the robot system and the process of generating gaits, we let the robot system walk on a flat floor.We conducted experiments under two conditions: when the robot's walking speed is slow and when it is fast.
To change the robot's walking speed, we changed the angular velocity of the legs by changing θ.However, we did not change parameters such as σ.We set the initial phase of each leg to 3π/2 and let the legs to start moving at the same time.
Figures 7 and 8 show the transition of each leg's phase ϕ i and the generated phase difference at low speed.The numbers in Fig. 8 correspond to the times indicated by numbers in Fig. 7.The borders in Fig. 7 mean one cycle of gait.As Figs. 7 and 8 show from the third step after the robot starts walking, the phase difference of each leg was kept around 90°. Also, the order of moving the legs is left fore (LF), right hind (RH), right fore (RF), and left hind (LH), which means that this gait is the same as the horse's walk gait.In this experiment, the angular velocity of the legs while the legs were not on the floor was approximately 30°/s (0.52 rad/s).
Figures 9 and 10 show the result at high speed.As Figs. 9 and 10 show from the fourth step after the robot starts walking, the phase difference of each leg was kept around 180°.In addition, the order of moving the legs is LF and RH, RF and LH, which means that this gait is the same as the horse's trot gait.In this experiment, the angular velocity of the legs while the legs were not on the floor was approximately 51°/s (0.89 rad/s).These results show that the quadruped robot system can generate gaits by reducing the angular velocity of the legs depending on the pressure on the feet.Also, the robot system can generate different gaits depending on moving speed.Furthermore, the characteristics of the generated gaits are similar to the horse's gaits.In our control method, we confined the factor of change in each leg's speed to feedback using weight-bearing balance.Therefore, we assume that the trigger for the break in the initial phase symmetry was slightly different in the weight of the robot that the limbs were supporting.
We have experimentally determined the parameters such as θ and σ that can stably produce these gestures.We expect that the dynamics simulator is necessary to determine these parameters quantitatively.In the future, we will use it to analyze in detail how the parameters affect the gaits.

Conclusion
In this paper, the authors constructed a quadruped robot controlled by the active gait generating method individually for four legs.The method is simply reducing the moving speed of the robot's legs according to the pressures of feet using pulse-type hardware neuron models (P-HNMs).We conducted experiments under two conditions: when the robot's walking speed is slow and when it is fast.As a result, the robot system actively generated phase differences of each leg.By analyzing the experimental results, we clarified the process of gait generation.Also, we confirmed that the generated phase differences were similar to the horse's gaits of walk and trot.These results show that animals may not use many biological neurons to generate gaits.Furthermore, the results suggest the possibility of realizing simple and bioinspired robot control.

Figure 3
Figure 3 shows the schematic and circuit diagram of the self-inhibited P-HNM that consists of a cell body model and an inhibitory synaptic model.The schematic diagram at the top of Fig. 3 shows the connection between the cell body model and the inhibitory neuron model, with a large

Fig. 6 Fig. 7
Fig. 6 Connection of single-leg controlling system and circuit diagram of peripheral circuit

Fig. 8
Fig. 8 Quadruped robot system and generated phase difference at low speed (7-a, 7-b, 7-c, and 7-d indicate the time points of Fig.7)