ErgoAI® Human factors intelligent training platform

ErgoAI ® Human intelligencepractical trainingThe platform is a core tool of human factor intelligence training for vocational education in the fields of robots, brain computer interface, intelligent cockpit, intelligent medical treatment, smart home and so on. Based on multimodal data synchronization and fusion, the platform combines artificial intelligence and edge computing technology to build a complete training system from data perception, multimodal feature fusion to intelligent applications. The platform integrates multimodal data such as electroencephalography, physiology, speech, eye movement, electromyography, and motion to achieve a deep understanding and state perception of human-computer interaction, promoting innovative teaching and application technologies such as embodied intelligence, brain computer interfaces, multimodal intelligent interaction, and human factors assessment.

Platform composition：

（1) Human factors intelligent training platform, covering the complete training process chain

The platform can be applied to different training environments, such as basic training rooms, metaverse training rooms, embodied intelligence training rooms, intelligent driving training rooms, and more future industry training rooms. The system is an integrated teaching platform that covers the entire process of training resource libraries, human factors intelligence perception, human factors intelligence training, and engineering applications.

Platform Features

lFull process coverage:From experimental design, signal acquisition, data processing, model training to application deployment, achievePractical training teachingClosed loop.

lMultimodal data fusion:Support synchronous collection and analysis of multiple data types such as electroencephalography, eye movement, electromyography, physiological signals, motion capture, speech interaction, and facial expression recognition.

lPowerful signal processing capability:Including noise reduction, filtering, and time-domain/Functions such as frequency domain/nonlinear analysis, feature engineering, data cleaning and annotation.

lAI driven intelligent analysis:integrationAI model training, validation, and deployment module, supporting personnel state recognition (such as fatigue, load, stress, attention, etc.)Practical training and teaching.

lHuman factors database and algorithm base:based onErgoAI Human Factors Intelligence Multi temporal Algorithm Base and Human Factors Engineering Human Machine Environment Database are used to construct pre training models for specific personnel states, combined with highly flexible training program management functions,studentCapable of efficiently building and optimizing models in a unified environment.

lEdge computing and wearable support:Provide edge computing terminal（ErgoAI Edge and ErgoAI Wearable support the collection and real-time processing of human factors data in mobile scenariosPractical training teaching.

lModular and Scalable Design:Including modules such as perception, statistics, experimental design, and application deployment, supporting custom stimulus content and experimental paradigms to adapt to different scenariospractical trainingRequirement.

lCross disciplinary application support:Applied to multiple fields such as smart healthcare, smart transportation, smart homes, and smart spacesapplicationScene.

lRich supporting resources:providepractical trainingGuidebook, quick start manual, data processing tutorial, etc., to reducepractical trainingThreshold.

（2）ErgoAI Human Factors Intelligent Multimodal Synchronous Tester

Product Features

lSupport local and cloud database deployment, with data upload, storage, and management capabilities;

lProvide a full process human factors intelligence development environment from data collection, preprocessing, model training, deployment verification to real-time inference;

lBuilt in single modal and multimodal data preprocessing algorithm library, human factors perception model library, supporting third-party data and task access;

lEquipped with high computing power edge computing unit, 1200 TOPS computing power; Support real-time processing and intelligent reasoning of multimodal human factors data;

lHuman factor intelligent data perception, widely compatible with multiple types of data sources such as EEG, near-infrared, physiology, audio and video, behavior, environment, etc., supports expanding any data source, can access third-party task data, and has good scalability and system integration capabilities

Platform Application：

Master multimodal intelligent interaction, embodied intelligence, human-computer interaction evaluation and other technologies

lTechnical Capability:

nMulti modal data collaborative processing capability: Master the acquisition, processing, and feature fusion techniques of multimodal data such as EEG, speech, vision, physiology, etc., and understand the complementarity and redundancy of cross modal data.

nCross modal model development capability: Master multimodal deep learning frameworks and design fusion models for practical scenarios.

lEngineering Capability:

nHuman centered intelligent system design, control, and evaluation capabilities: Based on multimodal data, the concept of human factors engineering is integrated into intelligent system design to promote human-machine collaboration and integration.

nCross disciplinary application ability of human factors intelligence models: Combining practical training projects in the fields of embodied robots, metaverse, intelligent cockpit, medical rehabilitation, etc., students will master the deployment and application ability of human factors intelligence models, and enhance their competitiveness in future industries.

ErgoLAB multimodal synchronization scheme:

Overall Overview

The ErgoLAB human-machine environment synchronization platform adopts multimodal data clock synchronization technology, which can complete the complete experimental and evaluation process, including project management, experimental design, synchronous acquisition, signal processing, data analysis, human factors intelligence evaluation, and visual reporting. It supports group testing and big data management based on cloud architecture technology.

ErgoLAB human-computer environment synchronization platform adopts the method of subjective and objective combination of multimodal data synchronous acquisition and multi-dimensional verification. The types of data real-time synchronization include brain cognitive data (EEG/BCI EEG and brain computer interface edge computing equipment, fNIRS/BCI near-infrared brain imager), visual data (Eyetracker eye tracker and line of sight interaction system), physiological data (physiological instrument includes: GSR/EDA、EMG、ECG、EOG、HRV、RESP、TEMP/SKT、PPG、SpO2）， Behavioral observation, body movements and facial expressions (basic emotions, emotional valence, micro expressions, etc.) data, biomechanical data (tension, grip, pinch, pressure, etc.), human-computer interaction data (including human-computer interface interaction behavior data and corresponding keyboard operations, mouse clicks, hovering, entering and exiting, etc.; mobile terminal human-computer interaction behavior data and corresponding finger trajectory operation behaviors such as clicking, zooming, sliding, etc.; VR terminal interface human-computer interaction behavior data and corresponding two handed operation picking, discarding, and controlling, etc.), Objective quantitative data such as VR space walking trajectory, as well as multi type spatiotemporal behavior trajectory data collection (including real-time synchronized collection of indoor, outdoor, and VR environment walking trajectory, driving trajectory, access status, visual interaction, emotional response, interactive operation behavior, etc.), and workspace and workspace environment data (temperature, humidity, noise, lighting, atmospheric pressure, humidity, dust, etc.); Provide complete data indicators for scientific research and application.

ErgoAI Human Factors Intelligence：

Introducing artificial intelligence technology into human factors engineering research tools deepens the human factors engineering industry, allowing experimental environments to be unrestricted by a single device or data indicator, and collecting and analyzing people from different typical industries or disciplines-Obtain human behavior data in the natural state during the interaction process between the machine and the environment system, and obtain data that is closer to the real human state. The platform also provides functional modules covering the whole process of scientific research and experiments, including project management, experimental design, synchronous collection, data analysis, comprehensive statistics and visual reports, and provides a one-stop human factors+artificial intelligence solution for multimodal human-machine environment research in combination with ErgoAI human factor intelligence edge computing platform. The multimodal synchronous human factor intelligence solution with ErgoLAB human-computer environment synchronization platform and ErgoAI human factor intelligence edge computing platform as the core has greatly improved the reliability and validity of the experimental results, while saving research manpower, material resources and time, and improving the overall efficiency of research and evaluation.

based onThe ErgoAI Human Factors Intelligence Multi temporal Algorithm Base and Human Factors Engineering Human Machine Environment Database are used to construct pre training models for specific personnel states. Combined with highly flexible training program management functions, users can efficiently build and optimize models in a unified environment. Thus achieving accurate real-time assessment and warning of personnel status, such as load status, stress status, fatigue status, situational awareness, and attention ability.

Kingfar Company Introduction:

Beijing Jinfa Technology Co., Ltd. (Jinfa Technology) isSpecialized, Sophisticated, Characteristic and InnovativeThe Little Giant，The first batch of specialized, refined, special and new key points in the new roundThe Little GiantEnterprises with intellectual property advantages, high-tech enterprises, and technology-based small and medium-sized enterprises；It includes new technology research and development institutions such as Beijing Human Factors Intelligent Engineering Technology Research Institute and Beijing Human Factors Engineering Design Institute Co., Ltd., and jointly builds multiple technology innovation platforms including Beijing Enterprise Technology Center, Beijing Undergraduate University Industry Research Deep Collaborative Education Platform, Suzhou Key Laboratory, Hunan Engineering Laboratory, Shandong Engineering Research Center, etc.

Jinfa Technology has undertaken and participated in multiple national key research and development programs, high-quality development projects of the Ministry of Industry and Information Technology, and national natural science foundation projects. Serving as the National Beacon CommitteeThe deputy leader unit of XR Extended Reality Standardization Working Group and the joint leader unit of Key Technology Group of Metaverse Standardization Working Group of the Ministry of Industry and Information Technology; Hosted and participated in the compilation of over 30 international, national, industry, and group standards.

Jinfa Science and Technology has innovated and developed home-made, autonomous and controllable human factor engineering and human factor intelligent edge computing series information and innovation products and technologies; Passed through EuropeCE、 Multiple international certifications including FCC in the United States, ROHS in the European Union, as well as ISO9001, ISO14001, ISO45001, etc. Accumulated more than 30 provincial and ministerial level certifications for new technologies and products, as well as multiple provincial and ministerial level scientific and technological awards; More than 5 applications worldwide30 items, 1 authorized2More than 0 international and national inventions, 15More than 0 international and national registered trademarks, and over 130 national software copyrights; We have served as a demonstration application for higher education institutions and equipment technology industry research institutes nationwide, and have supported research scholars and technology workers to publish academic papers in both Chinese and Englishexceed1100 articles.