[EOL] M5Stack LLM (large language model) Module (AX630C)

Product Status Notice This product is EOL (End of Life). Please order the new version: Module LLM Kit /* ===== Scoped Description Style ===== */ .product-description.rte { font-fam ily: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, "Helvetica Neue", Arial, sans-serif; color: #2c2c2c; line-height: 1.65; font-size: 16px; } /* ===== Headings ===== */ .product-description.rte h2 { font-size: 1.8em; color: #0D47A1; border-left: 4px solid #1f6fe5; padding-left: 12px; margin-top: 32px; margin-bottom: 16px; } /* ===== H3 Titles Optimization ===== */ .product-description.rte h3 { font-size: 1.4em; color: #0D47A1; margin-top: 24px; margin-bottom: 12px; font-weight: 500; padding-bottom: 6px; border-bottom: 2px solid #e6e6e6; } /* ===== Paragraphs ===== */ .product-description.rte p { margin-bottom: 20px; line-height: 1.8; color: #4a4f57; font-size: 16px; } /* ===== Paragraph Images (only in description) ===== */ .product-description.rte img { display: block; max-width: 100%; height: auto; margin: 24px auto; border-radius: 12px; box-shadow: 0 8px 24px rgba(0, 0, 0, 0.06); } /* ===== Lists ===== */ .product-description.rte ul { padding-left: 20px; margin-bottom: 16px; list-style-type: disc; } .product-description.rte li { margin-bottom: 6px; } /* ===== Links ===== */ .product-description.rte a { color: #0288D1; text-decoration: none; transition: color 0.3s ease; } .product-description.rte a:hover { color: #01579B; } /* ===== M5Stack-style Spec Table ===== */ .product-description.rte .table-container { width: 100%; margin: 24px 0; overflow-x: auto; } .product-description.rte .table-container table { width: 100%; border-collapse: collapse; font-family: inherit; font-size: 14px; color: #2c2f36; background-color: #ffffff; border-radius: 10px; overflow: hidden; box-shadow: 0 4px 12px rgba(0, 0, 0, 0.04); } .product-description.rte .table-container thead th { background: #1f6fe5; color: #ffffff; padding: 14px 16px; text-align: center; font-weight: 600; border: none; vertical-align: middle; } .product-description.rte .table-container td { padding: 14px 16px; border-bottom: 1px solid #e6ebf2; vertical-align: middle; } .product-description.rte .table-container tbody td:first-child { width: 36%; text-align: center; font-weight: 500; color: #4a4f57; background-color: rgba(31, 111, 229, 0.02); } .product-description.rte .table-container tbody tr:nth-child(even) { background-color: #f7f9fc; } @media (hover: hover) { .product-description.rte .table-container tbody tr:hover { background-color: #eef3ff; } } /* ===== Learn & Documents Button ===== */ .product-description.rte #learn-and-documents-btn { display: inline-flex; align-items: center; padding: 6px 14px; background-color: #1f6fe5; color: #ffffff; font-weight: 600; border-radius: 6px; margin-top: 8px; text-decoration: none; transition: background 0.3s ease; } .product-description.rte #learn-and-documents-btn:hover { background-color: #1661c1; } /* ===== Responsive Design for Smaller Screens (with table adjustments) ===== */ @media screen and (max-width: 768px) { .product-description.rte .table-container table, .product-description.rte .table-container thead, .product-description.rte .table-container tbody, .product-description.rte .table-container th, .product-description.rte .table-container td, .product-description.rte .table-container tr { display: block; width: 100%; } .product-description.rte .table-container thead { display: none; } .product-description.rte .table-container tbody tr { padding: 12px 0; border-bottom: 1px solid #e6ebf2; } .product-description.rte .table-container tbody td { padding: 8px 16px; border: none; text-align: left; } .product-description.rte .table-container tbody td:first-child { width: 100%; background: none; color: #1f6fe5; font-weight: 600; padding-top: 16px; } .product-description.rte .table-container tbody td:last-child { padding-bottom: 16px; color: #2c2f36; line-height: 1.6; } /* Ensure button appears correctly on mobile */ .product-description.rte #learn-and-documents-btn { font-size: 14px; padding: 8px 16px; } } Description Module LLM is an integrated offline large language model (LLM) inference module, designed for terminal devices that require efficient and intelligent interaction. Whether in smart homes, voice assistants, or industrial control, Module LLM can provide you with a smooth and natural AI experience without relying on the cloud, ensuring privacy, security, and stability. This module integrates the StackFlow framework, and with the Arduino/UiFlow library, you can easily achieve edge-side intelligence with just a few lines of code. Equipped with the AX630C SoC processor, it integrates a 3.2TOPs high-efficiency NPU, natively supporting Transformer models, and can easily handle complex AI tasks. It comes with 4GB LPDDR4 memory (1GB for user use, 3GB dedicated to hardware acceleration) and 32GB eMMC storage, supporting parallel loading and serial inference of multiple models, ensuring smooth multitasking. The operating power consumption is only about 1.5W, much lower than similar products, making it energy-efficient and suitable for long-term operation. Module LLM integrates a microphone, speaker, TF storage card, USB OTG, and RGB status light, meeting diverse application needs and easily enabling voice interaction and data transmission. In terms of flexible expansion, the onboard SD card slot supports firmware cold/hot upgrades, and the UART communication interface simplifies connection and debugging, ensuring continuous optimization and expansion of module functions. The USB port supports automatic master/slave switching, serving as both a debugging port and allowing connection to more USB devices such as cameras. Paired with the LLM debugging kit, it can expand to a 100M Ethernet port and kernel serial port, functioning as an SBC. This module is compatible with multiple models and comes pre-installed with the Qwen2.5-0.5B large language model, featuring built-in KWS (wake word), ASR (speech recognition), LLM (large language model), and TTS (text-to-speech) functions, supporting separate calls or pipeline automatic flow, making development convenient. It will later support Qwen2.5-1.5B, Llama3.2-1B, and InternVL2-1B, among other edge-side LLM/VLM models, supporting hot updates to keep up with community trends and adapt to AI tasks of varying complexity. In terms of visual recognition capabilities, it supports CLIP, YoloWorld, and other Open world models, with future updates including DepthAnything, SegmentAnything, and other advanced models, empowering intelligent recognition and analysis. Module LLM is plug-and-play, paired with M5 hosts, enabling a plug-and-play AI interaction experience. Users can integrate it into existing smart devices without complicated setups, quickly enabling intelligent functions and enhancing device intelligence. This product is suitable for offline voice assistants, text-to-speech conversion, smart home control, interactive robots, and more. Features Offline inference, 3.2T@INT8 precision computing power Integrated KWS (wake word), ASR (speech recognition), LLM (large language model), TTS (text-to-speech) Multiple model parallelism Onboard 32GB eMMC storage and 4GB LPDDR4 memory Onboard microphone and speaker Serial communication SD card firmware upgrade Supports ADB debugging RGB indicator light Built-in Ubuntu system Supports OTG function Supports Arduino/UIFlow Includes 1 x Module LLM Applications Offline voice assistant Text-to-speech conversion Smart home control Interactive robots Specifications Specification Parameter Processor SoC AX630C@Dual Cortex A53 1.2 GHz MAX.12.8 TOPS @INT4, and 3.2 TOPS @INT8 Memory 4GB LPDDR4 (1GB system memory + 3GB dedicated to hardware acceleration) Storage 32GB eMMC5.1 Communication Interface Serial communication, default baud rate 115200@8N1 (adjustable) Microphone MSM421A Audio Driver AW8737 Speaker 8Ω@1W, size: 2014 cavity speaker Built-in Functional Units KWS (wake word), ASR (speech recognition), LLM (large language model), TTS (text-to-speech) RGB Light 3x RGB LED@2020 driven by LP5562 (status indicator) Power Consumption Idle: [email protected], Full load: [email protected] Button Used for entering download mode for firmware upgrade Upgrade Interface SD card/Type C port Operating Temperature 0-40°C Product Size 54.0 x 54.0 x 13.0mm Product Weight 17.1g Package Size 132.0 x 95.0 x 16.0mm Gross Weight 31.9g Learn and Documents → DOCUMENTS Show more