RF-DETR TensorRT C++ demo

[mohamedsamirx]

Description

This pull request introduces a C++ TensorRT demo for building the RF-DETR TensorRT engine and utilizing it in C++. The implementation includes support for CUDA preprocessing.
I have Put everything in the same directory as this #76 pull request for faster review process

Please delete options that are not relevant.

• New feature (non-breaking change which adds functionality)

How has this change been tested, please provide a testcase or example of how you tested the change?

Tested it on a photo and a video and both work really well

[CLAassistant]

All committers have signed the CLA.

[isaacrob]

we're already planning to do tensorrt native in this repo, yes? @Borda do you have thoughts on the benefit of having c++ native support in this repo? I don't feel like I understand the value

[mohamedsamirx]

I thought I would never hear about this PR again. It is understandable if the library focuses only on Python. However, C++ is usually for people looking for deployment. I don't know if this is part of the Roboflow team's plan, but that was my intention when opening it.

I would love to work on other TensorRT-related tasks if the library needs contributors.

[isaacrob]

haha @mohamedsamirx yeah trying to clean up lingering PRs :) now that @Borda is onboard and making sure what would otherwise have just been a research repo is up to snuff for long term relevance

the pipeline we've been suggesting for folks for deployment is via https://github.com/roboflow/inference .. what is the utility of having a devoted demo here instead of just providing folks with the tensorrt engine and having them use whatever else they'd normally use to deploy that within c++?

[mohamedsamirx]

I mean yeah, your thoughts make sense