SensorFusionKnowledgeDistillationCompositeHAR/CITATION.cff at main · Tiny-Composite-and-Complex-ADL/SensorFusionKnowledgeDistillationCompositeHAR · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
cff-version: 1.2.0
message: "If you use this software, please cite it using the metadata from this file."
type: software
authors:
  - family-names: "Rafee"
    given-names: "Athar Noor Mohammad"
    email: noor.mohammad.rafee@g.bracu.ac.bd
    affiliation: "Computing for Sustainability and Social Good (C2SG) Research Group, Department of Computer Science and Engineering, United International University, Dhaka, Bangladesh; Department of Computer Science and Engineering, School of Data and Sciences, BRAC University, Dhaka, Bangladesh"
    orcid: https://orcid.org/0009-0002-3608-6478
  - family-names: "Clear"
    given-names: "John"
    affiliation: "Department of Computer Engineering, Charles W. Davidson College of Engineering, San José State University, San José, CA, United States of America"
    orcid: https://orcid.org/0009-0009-9814-3950
  - family-names: "Noor"
    given-names: "Jannatun"
    email: jannatun.noor@bracu.ac.bd
    affiliation: "Computing for Sustainability and Social Good (C2SG) Research Group, Department of Computer Science and Engineering, United International University, Dhaka, Bangladesh; Department of Computer Science and Engineering, School of Data and Sciences, BRAC University, Dhaka, Bangladesh"
    orcid: https://orcid.org/0000-0001-9669-151X
title: "Composite human activity recognition utilizing knowledge distillation and sensor fusion focusing on resource constrained microcontrollers"
repository-code: "https://github.com/Tiny-Composite-and-Complex-ADL"

preferred-citation:
  type: article
  title: "Composite human activity recognition utilizing knowledge distillation and sensor fusion focusing on resource constrained microcontrollers"
  authors:
    - family-names: "Rafee"
      given-names: "Athar Noor Mohammad"
    - family-names: "Clear"
      given-names: "John"
    - family-names: "Noor"
      given-names: "Jannatun"
  journal: "Expert Systems with Applications"
  volume: 298
  start: 129652
  year: 2026
  issn: "0957-4174"
  doi: "10.1016/j.eswa.2025.129652"
  url: "https://www.sciencedirect.com/science/article/pii/S0957417425032671"
  keywords:
    - "TinyML"
    - "Low-cost"
    - "Composite human activity recognition"
    - "Microcontrollers"
    - "Resource constrained AI"
    - "Neural networks"
    - "Knowledge distillation"
  abstract: "This study presents a cost-effective, low-computation system for composite Human Activity Recognition (HAR) that leverages knowledge-distilled neural networks on a Microcontroller Unit (MCU) to minimize reliance on cloud processing. A key contribution of this work is the investigation of plantar pressure sensor data within a knowledge distillation framework, addressing a notable gap in the existing literature. The proposed solution centers around the ESP32-S3 DevKit C1, equipped with a dual-core 240 MHz Tensilica chip, 320 KiB of usable Static Random Access Memory (SRAM), and built-in Wi-Fi and Bluetooth. Significantly, both the teacher and the student models surpass existing state-of-the-art methods, achieving F1-scores of 99.33 %, 98.36 %, and 97.68 % respectively, in classifying a comprehensive set of 21 activities (15 composite and 6 simple). The distilled student models demonstrate remarkable efficiency, with execution times of 1.83 and 0.64 s, memory footprints of only 62 KB and 82 KB, and flash memory usage of approximately 209 KB and 127 KB, while maintaining low power consumption of 210 mW and 215 mW, respectively. Furthermore, we have developed an end-to-end prototype that integrates the ESP32-S3 with a WitMotion Inertial Measurement Unit (IMU) sensor. This system autonomously manages data acquisition, feature extraction, and inference in under 7 s with a total power consumption of approximately 295 mW."