Abstract:Flexible sensors capable of detecting both pressure and magnetic fields serve as the cornerstone for merging the real and virtual worlds and facilitate the advancement of wearable devices by providing a rapid response, user-friendly interface, and flexible human-machine interaction method. Constrained by the sensing structure, the arithmetic power of miniaturized wearable platforms and power consumption, these devices are currently difficult to realize the simultaneous sensing of multiple information such as human posture and position, as well as the deployment of complex models required for multi-information interaction. In order to bi-perceptive of high sensitivity and fast response, we proposed the magnetostrictive flexible sensor, which consists of the Co-Fe film and plane magnetic field sensing coils. The maximal sensitivity of the sensor is 22 mV/mm in the bending of 10~65 mm. The maximal sensitivity of the sensor is 1.78 mV/(kA/m) in the magnetic field of 1~11 kA/m. The sensor demonstrates excellent dynamic output stability, with sensitivity variations of less than 1.6% under different ρ and H conditions at frequencies of 1 to 4 Hz. By analyzing the input/output signal characteristics of the dual-sensing sensor, a sensing system supporting sensor signal processing and transmission is constructed to realize dual-sensing data acquisition. Adaptive fuzzy neural network is used to analyze the gesture and position information for gesture recognition, achieving a classification accuracy of 90.1% for 12 gestures that are commonly confused by traditional stress or bending sensors. In addition, the information interaction capability of the system is enhanced by combining the haptic feedback method, which helps the user to better grasp the effect of movement and relative position in the virtual environment by generating vibration feedback with different amplitudes and durations. The sensing system infers the user′s gesture movements and commands, and haptic feedback device response results, enabling a bidirectional information exchange between the user and the device.