New Kafka Endpoint - #4774

Open

fpetrini15 wants to merge 2740 commits into

mainfrom

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 4, 2022

remove java client build from sdk

jbkyang-nvi
authored and
mc-nv
committed
e1fea85
Remove java client examples install

dzier
authored and
mc-nv
committed
bd40000
Update jetson docs for Jetpack 22.03 (#4120)

Hemant Jain
authored and
mc-nv
committed
2bbec79

Commits on Apr 5, 2022

Add test case for shutdown (#4143)
GuanLuo
authored
095a44e
Enable capi for pa (#4161)
krishung5
authored
0d87c41
Use correct error message in L0_lifecycle(#4156)
krishung5
authored
43e5076

Commits on Apr 6, 2022

Update docs for ORT support on Jetson (#4157) (#4167)
Hemant Jain
authored
6f3519a
Update for 22.03 model gen (#4173)
Hemant Jain
authored
b7561f9
Move Java client examples to build (#4116)
jbkyang-nvi
authored
daf1c8f

Commits on Apr 7, 2022

Add metric API unit test to L0_metrics (#4163)
GuanLuo
authored
aa73af1
Set http address for metrics when http service is disable (#4175)
krishung5
authored
25c6fec
Record INFER_RESPONSE_COMPLETE only at the first callback (#4176)
tanmayv25
authored
721ecb5
Add testing for the lifetime of BLS tensors (#4147)
Tabrizian
authored
464629e
Add pointer to 'raw binary data' documentation (#4182)
deadeyegoodwin
authored
3145219

Commits on Apr 8, 2022

Commits on Apr 9, 2022

Update test to use new option (#4190)
matthewkotila
authored
93ab8f7

Commits on Apr 11, 2022

Add Model Register API test (#4191)

the-david-oy
and
GuanLuo
authored
3fb8d41

Commits on Apr 12, 2022

Fix build.py to accept gpu-base image for CPU only (#4208)
Hemant Jain
authored
3c89895
Update build docs for --image,gpu-base (#4209)
Hemant Jain
authored
a48f47e

Commits on Apr 13, 2022

Update build.py to generate scripts containing build commands (#4174)
deadeyegoodwin
authored
9278504
Fix compose.py to allow configurable gpu-min container (#4210)
Hemant Jain
authored
905c5f1
updated qa tests to expect the new max_batch_size (#4092)
nv-kmcgill53
authored
22c40ce
Test Documentation Rendering (#4218)
the-david-oy
authored
127df4f
Add testing for incorrect shape argument in PA (#4192)
Tabrizian
authored
3a11151

Commits on Apr 14, 2022

Fix L0_backend_python (#4207)
Tabrizian
authored
3c535ef
Update master to track development for 2.22.0 / r22.05
mc-nv
committed
c45d3b3
Add documentation for incremental builds (#4222)
deadeyegoodwin
authored
f80f203

Commits on Apr 15, 2022

Commits on Apr 16, 2022

Add trace test for C++ client (#4216)
krishung5
authored
f42aae9
Fix instance type to CPU for optional python model (#4230)
Hemant Jain
authored
093ec76

Commits on Apr 19, 2022

Commits on Apr 20, 2022

Start using tag reference for 'vcpkg'
mc-nv
committed
dcd3a7d
Add `load-model=*` tests and documentation (#4256)
rmccorm4
authored
a4de42b

Commits on Apr 21, 2022

Add argument validation tests (#4180)
Tabrizian
authored
837cdc8
Document TFS and TS support in perf_analyzer (#4258)
tanmayv25
authored
43b6e0c

Commits on Apr 22, 2022

Add white background to PNG images
dzier
committed
891d4bb
Merge PersistentBackendManager into TritonBackendManager (#4268)
deadeyegoodwin
authored
82c2ec9
Fix compose.py to use updated container_versions() function from build.py (#4267)
deadeyegoodwin
authored
5124283

Commits on Apr 26, 2022

Commits on Apr 27, 2022

Commits on Apr 28, 2022

Add TYPE_BF16 scaffolding (#4295)
rmccorm4
authored
57ed647
Improve Server API (C API) documentation (#4304)
deadeyegoodwin
authored
27b93ba

Commits on Apr 29, 2022

Update README and docs post-22.04 release
mc-nv
committed
064c585
Documentation updates for Server API (C API) (#4312)
deadeyegoodwin
authored
4274d13
Fix expected test count on jetson (#4314)
Tabrizian
authored
a6504a3
Fix typo (#4317)
Hemant Jain
authored
74eb389
GPG CUDA Linux Repository Key Rotation
mc-nv
committed
382bdaa

Commits on May 2, 2022

Add test for decoupled API in Python backend (#4290)

Tabrizian
and
tanmayv25
authored
4e57c69

Commits on May 3, 2022

Update README and versions for 22.04 branch
mc-nv
committed
0ac0c21
Fix CPU only failure for pytorch backend (#4227)

Hemant Jain
authored and
mc-nv
committed
a04eeb9
Update copyright period
mc-nv
committed
e04b52a

Commits on May 4, 2022

Commits on May 5, 2022

Commits on May 6, 2022

Fix test failures on Jetpack (#4316) (#4342)

Hemant Jain
and
Tabrizian
authored
0b09e8e
Add GPU bls tests for decoupled API
Tabrizian
committed
3e8c7bc
Add note on instance_groups for ensemble models (#4349)
rmccorm4
authored
556d9cf

Commits on May 7, 2022

Update ORT to 1.11.1 (#4347)
pranavsharma
authored
cffa05c

Commits on May 9, 2022

Enable Triton for SageMaker MME mode (#4181)
nikhil-sk
authored
859c8cd
Add testing for PyTorch string I/O (#4315)
Hemant Jain
authored
d4bfcfd
Improve GRPC load model with file override to accept file binary (#4338)
GuanLuo
authored
b265f06

Commits on May 10, 2022

Commits on May 11, 2022

Update master to track development for 2.23.0 / r22.06
mc-nv
committed
1a911e9

Commits on May 12, 2022

Add copyrights to test data for Java resnet tests (#4370)
jbkyang-nvi
authored
53bc802

Commits on May 13, 2022

Fix typo in extension_classfication.md (#3943)
zhoukaidev
authored
85a0a39

Commits on May 16, 2022

Add L0_jave_memory_growth logging on failure (#4381)
GuanLuo
authored
df02d01

Commits on May 18, 2022

Fix trace_timestamps_ memory growth in GRPC server (#4383)
rmccorm4
authored
a5638a6

Commits on May 19, 2022

Add warmup failure case in L0_warmup (#4382)
GuanLuo
authored
4717794

Commits on May 20, 2022

Add L0_libtorch_io_names test and update docs for new Naming Convention for PyTorch backend (#4393)
Hemant Jain
authored
0f1d027
Moving to recomended approach with using cuda-keyring package
mc-nv
committed
9253f3f
Improve error message for shared memory manager (#4417)
Tabrizian
authored
41ae518
Add section on cc_model_filenames to model config docs (#4403)
rmccorm4
authored
5af4cdb

Commits on May 21, 2022

Improve README (#4419)
dzier
authored
2289381
Add testing for GPU support in decoupled (#4377)
Tabrizian
authored
09adeb4

Commits on May 23, 2022

Re-throw certain specific OOM errors as 507 for SageMaker MME + repo path enhancement (#4392)
nikhil-sk
authored
cd1f457

Commits on May 24, 2022

Enable nvtx markers in pytorch backend (#4424)
tanmayv25
authored
a29155e

Commits on May 25, 2022

Commits on May 28, 2022

Removing image layer
mc-nv
committed
063d440
Update NGC versions post-22.05 release
mc-nv
committed
21f3545

Commits on May 31, 2022

Fix L0_copyrights (#4446)
Tabrizian
authored
3257e00

Commits on Jun 1, 2022

Commits on Jun 2, 2022

Autocomplete is Used by Triton Supported Backends (#4395)

nv-kmcgill53
and
tanmayv25
authored
17d3d62
Correct number of resource copies for R4 (#4455)
winstonhic
authored
a27c32e
use job ID in cloud storage test to ensure exclusive usage (#4458)
GuanLuo
authored
170e2f7

Commits on Jun 3, 2022

Commits on Jun 6, 2022

Fix L0_backend_python_jetson (#4465)
krishung5
authored
4b1198b
Build testing custom op with backward compatibility (#4468)
GuanLuo
authored
794297e

Commits on Jun 7, 2022

Commits on Jun 8, 2022

Add conda to the build container (#4476)

Tabrizian
and
szalpal
authored
dea7a39
Fix copyright and test count (#4493)
Tabrizian
authored
124b6d2
Fix invalid read in multi_server.cc (#4496)
GuanLuo
authored
fbbb859
Update master to track development for 2.24.0 / 22.07
mc-nv
committed
2f55a5f
Fix link (#4498)
krishung5
authored
78fbbdc
Tests for setting dynamic batching scheduler during python autocomplete (#4473)
nv-kmcgill53
authored
1345415

Commits on Jun 14, 2022

Fix Trace Documentation Rendering (#4514)
the-david-oy
authored
1148928

Commits on Jun 15, 2022

Commits on Jun 18, 2022

Protect shared_memory_map_ from concurrent access (#4518)
kthui
authored
1d2519c

Commits on Jun 21, 2022

Updated documentation and tests regarding default CPU model instances (#4535)
nv-kmcgill53
authored
13f5532

Commits on Jun 22, 2022

Add L0_backend_bls test (#4494)
krishung5
authored
6c1d501
Update README with NVAIE messaging
dzier
committed
40a54ef
Fix L0_build_variants (#4539)
Tabrizian
authored
f88bc5a

Commits on Jun 28, 2022

Increased timeout from 3600 to 4000 (#4553)
Hemant Jain
authored
421ce2d

Commits on Jun 30, 2022

Don't infer DALI_VERSION from env variable (#4565)
szalpal
authored
ac0a427
Add http asyncio python client (#4551)
kthui
authored
9570dd1
Add grpc asyncio python client (#4546)
kthui
authored
4450fd6

Commits on Jul 1, 2022

add pa ground truth (#4552)
debermudez
authored
265e3fc
Update README and versions for 22.06 branch
mc-nv
committed
4ba0b39

Commits on Jul 4, 2022

Commits on Jul 5, 2022

Fix L0_perf_nomodel (#4586)
Tabrizian
authored
4d9f156
Fix unstable collision test in L0_lifecycle (#4568)
GuanLuo
authored
f765bab
Fix L0_model_config (#4588)
nv-kmcgill53
authored
c1c931b

Commits on Jul 6, 2022

Fix unescaped newline, use comma instead for simplicity, add -e to avoid similar future errors (#4591)
rmccorm4
authored
9a389e4

Commits on Jul 7, 2022

Commits on Jul 8, 2022

Commits on Jul 11, 2022

Fix for optional secrets.token in deploy/fleetcommand helm chart (#3809)
treyd
authored
f974b63

Commits on Jul 12, 2022

Commits on Jul 13, 2022

Commits on Jul 14, 2022

Commits on Jul 15, 2022

Commits on Jul 19, 2022

Fix copyrights and formatting (#4664)
jbkyang-nvi
authored
ef95683
Replace perf_client usage with unit tests WAR (#4670)
rmccorm4
authored
fe8e84f

Commits on Jul 20, 2022

Initial doc on mode-load-thread-count (#4677)
rmccorm4
authored
070a887
Add testing for PA optional inputs (#4613)
matthewkotila
authored
22c2d2f

Commits on Jul 21, 2022

Commits on Jul 22, 2022

Check errors on startup models and condense lifecycle test (#4681)
rmccorm4
authored
799f6ec
Fix L0_backend_python (#4680)
Tabrizian
authored
e69d7b4
Add Tracing to Perf Analyzer GRPC/HTTP Client (#4684)
the-david-oy
authored
737c219

Commits on Jul 26, 2022

Lifecycle test fixes (#4686)
rmccorm4
authored
a1ed241

Commits on Jul 28, 2022

Fix PA test stability (#4694)
matthewkotila
authored
9405d4d
Add test coverage to check if output tensor is on GPU for Python Backend (#4704)
krishung5
authored
18b0c11
Support bfloat16 in client (#4705)
the-david-oy
authored
5945ddb

Commits on Jul 29, 2022

Commits on Jul 30, 2022

Modify protobuf usage to reflect version upgrade (#4699)
GuanLuo
authored
11e5f8c

Commits on Aug 2, 2022

Update README and versions for 22.07 branch
mc-nv
committed
59d98ad
Enable ORT 1.12.0 support
mc-nv
committed
a4c2433
Add testing for tf ops initialization (#4624)

committed
b6c26be
fix formatting and L0 copyright

jbkyang-nvi
authored and
mc-nv
committed
714a79e
Update README for 22.07 release
mc-nv
committed
22107aa

Commits on Aug 3, 2022

Add end-to-end config tuning doc (#4706)
rmccorm4
authored
ed8b209

Commits on Aug 4, 2022

Commits on Aug 5, 2022

Commits on Aug 6, 2022

Add cloud storage credential management (#4695)
kthui
authored
761e900
Updating scripts to accept default variables
mc-nv
committed
b0e024e
adding missed model directory
mc-nv
committed
01817a0

Commits on Aug 8, 2022

Excluding 'qa/L0_trt_dla_jetson/trt_dla_model_store' modelsf form verification
mc-nv
committed
90b408b

Commits on Aug 9, 2022

Allow multiple servers to bind to the same http/grpc port (#4732)
krishung5
authored
2a8c71e

Commits on Aug 10, 2022

Fix instance group setting link (#4755)
Tabrizian
authored
151e474
Server changes for new logging extension (#4640)
fpetrini15
authored
5a24bed
Update master to track development for 2.26.0 / r22.09
mc-nv
committed
75e06c2

Commits on Aug 11, 2022

Add bls_undefined model to model repo and add to c_api test (#4758)
debermudez
authored
638f850

Commits on Aug 12, 2022

Add set +e and -e to the capi test addition (#4762)
debermudez
authored
e8980c7

Commits on Aug 16, 2022

Commits on Aug 18, 2022

Removing unused peace of code
mc-nv
committed
1ea74c0

Commits on Aug 19, 2022

Load Shared Libraries Dynamically (#4793)
the-david-oy
authored
795a128
Migrate OV to 2022.1 (#4751)
kthui
authored
1587dd3

Commits on Aug 23, 2022

Remove tagged openvino backend (#4805)
kthui
authored
e723279

Commits on Aug 24, 2022

Commits on Aug 26, 2022

Add testing for Python backend logging (#4802)
fpetrini15
authored
a30f51c
Update LICENSE (#4692)
masguit42
authored
ec6e1a3

Commits on Aug 29, 2022

Update README and versions for 22.08 branch
mc-nv
committed
221c73b
Add CPU metrics CLI options and docs (#4803)
rmccorm4
authored
fe576bc

Commits on Aug 30, 2022

Add testing to ensure grpc time is not zeroed out (#4823)
debermudez
authored
feb1613

Commits on Sep 2, 2022

Commits on Sep 8, 2022

Commits on Sep 9, 2022

Fix broken links after refactor (#4861)
rmccorm4
authored
1a2c498
Update master to track development for 2.27.0 / r22.10
mc-nv
committed
0e1257c
Uplift GO version
mc-nv
committed
c787771

Commits on Sep 10, 2022

Install kafka lib
fpetrini15
committed
a68c52d
Adding boost library
fpetrini15
committed
85c8661
New kafka files
fpetrini15
committed
b8763a4
Intermediate Checkin
fpetrini15
committed
13ee61e
Add Kakfa Option
fpetrini15
committed
ec3004b
Container and compile changes
fpetrini15
committed
6859117
Fix gitlab warnings
fpetrini15
committed
b100633
Build kafka
fpetrini15
committed
7a51e50
Cleanup
fpetrini15
committed
8a4e337
Restore http_server.cc
fpetrini15
committed
6cbc2de
Adding comments
fpetrini15
committed
55b6378
Manually adding back CPU Metrics flags
fpetrini15
committed
2abddda
Review comments
fpetrini15
committed
ee6d02e
Pushing in case credentials expire
fpetrini15
committed
cfe9209