Research

Research

81539 bookmarks
Newest
Amdahl's Law in the Multicore Era
Amdahl's Law in the Multicore Era
Augmenting Amdahl's law with a corollary for multicore hardware makes it relevant to future generations of chips with multiple processor cores. Obtaining optimal multicore performance will require further research in both extracting more parallelism and making sequential cores faster.
Amdahl's Law in the Multicore Era
Tensor.Art
Tensor.Art
AI model sharing platform, online run models to generate image,viode and traning model for free. Your can upload and download models, include Checkpoint, Embedding, ControlNet, LoRA, Pony, LoCon, LyCORIS. Also we offer some base model like Stable Diffusion 1.5, SDXL and Hunyuan-DiT, Wan, FLUX, VACE to generate.
Tensor.Art
SLP Diagrams
SLP Diagrams
The diagrams below were prepared by Jenna Hartel , based upon the work of Robert A. Stebbins. These diagrams may be reproduced      without permission, but please acknowledge their source as:...
SLP Diagrams
Efficient NPU–GPU scheduling for real-time deep learning inference on mobile devices
Efficient NPU–GPU scheduling for real-time deep learning inference on mobile devices
As the need for on-device artificial intelligence (AI) has increased in recent years, mobile devices tend to be equipped with multiple heterogeneous processors, including CPU, GPU, and Neural Processing Unit (NPU). While NPUs can offer low-cost and real-time AI processing capabilities for Deep Neural Network (DNN) inference, its limited resources often lead to a trade-off between performance and accuracy, potentially resulting in a non-trivial accuracy drop. To address this problem, we propose a new NPU–GPU Scheduling (NGS) framework for DNN-based video analytics. The main challenge lies in determining when and how to execute inference on the NPU/GPU to satisfy the performance objectives. To make more precise scheduling decisions, we first propose a new image complexity assessment model to replace the existing normalized edge density metric. Then, we formulate the scheduling problem with the objective of maximizing inference accuracy under the given latency constraint, and introduce an adaptive solution based on dynamic programming to determine which frames should be processed on the GPU and when to exit from inference for each of them. Extensive experiments conducted on a real mobile device show that our NGS framework substantially outperforms other solutions, and achieves a close-to-oracle performance.
Efficient NPU–GPU scheduling for real-time deep learning inference on mobile devices
Family Name - EADiva
Family Name - EADiva
encodes the proper noun to identify a group of persons closely related by blood or forming a household. This could be a single family unit, or an extended family.... Read the Rest »
Family Name - EADiva