Convert popular Deep learning models to TensorRT using C++ API (preferably)

Using TensorRT integration in Tensorflow to perform CNN inference.

In this repository, you will receive information (notebooks) of TensorFlow model optimization using TensorRT and TF-Lite. You will be able to: Understand the fundamentals of optimization using TF-TRT and TF-Lite, deploy deep learning models by reduced precision (FP32, FP16 and INT8) on the inference stage and calibrate the weights

Samples from TensorRT installation

C++ library based on tensorrt integration

Implementation of popular deep learning networks with TensorRT network definition API

TensorRT Server

Tensorrt implementation for Yolo

Image classification with NVIDIA TensorRT from TensorFlow models.

This repo consists of model optimization using TensorRT package.

Implementation of popular deep learning networks with TensorRT network definition APIs

Yolo v4 Object Detection Model

Jetbot Voice to Action Tools is a set of ROS2 nodes that utilize the Jetson Automatic Speech Recognition (ASR) deep learning interface library for NVIDIA Jetson

Face mask detector for COVID-19 monitoring implemented on a Jetson Nano. The entire framework performs real-time at a 7 Hz.

Test of tensorRT on a custom net using jetson devices

This bootcamp is designed to give NLP researchers an end-to-end overview on the fundamentals of NVIDIA NeMo framework, complete solution for building large language models. It will also have hands-on exercises complimented by tutorials, code snippets, and presentations to help researchers kick-start with NeMo LLM Service and Guardrails.

Machine Learning API built using Fast API.

Hardware accelerated OpenCV, Torch & Tensorrt Ubuntu 20.04 docker images for Jetson Nano containing any python version you need up until the latest 3.12

A REST API for Caffe using Docker and Go