Creates an NVTX marker for profiling. This function places a single marker point in NVIDIA Tools Extension (NVTX) profiling tools like Nsight Systems, useful for marking specific events. Args: msg (str): The message/name for the NVTX marker. color (str, optional):
(msg: str,
color: str = "grey",
domain: str = "TensorRT-LLM",
category: Optional[str] = None)
| 959 | |
| 960 | |
| 961 | def nvtx_mark(msg: str, |
| 962 | color: str = "grey", |
| 963 | domain: str = "TensorRT-LLM", |
| 964 | category: Optional[str] = None): |
| 965 | """ |
| 966 | Creates an NVTX marker for profiling. |
| 967 | |
| 968 | This function places a single marker point in NVIDIA Tools Extension (NVTX) |
| 969 | profiling tools like Nsight Systems, useful for marking specific events. |
| 970 | |
| 971 | Args: |
| 972 | msg (str): The message/name for the NVTX marker. |
| 973 | color (str, optional): The color to use for the marker in the profiler. Defaults to "grey". |
| 974 | domain (str, optional): The domain name for the marker. Defaults to "TensorRT-LLM". |
| 975 | category (str, optional): The category for the marker. Defaults to None. |
| 976 | """ |
| 977 | nvtx.mark(msg, color=color, category=category, domain=domain) |
| 978 | |
| 979 | |
| 980 | def volume(d: Sequence[int]): |
no outgoing calls
no test coverage detected