The Comment Remover is designed specifically to remove comments from parquet files that contain C# code. The code is specifically designed to process files found at hf.co/datasets/microsoft/LCC_csharp, but it could be altered to work with a parquet dataset of any type with minor modifications to the DataReader class, specifically lines 40 and 41.
-
Notifications
You must be signed in to change notification settings - Fork 0
Removes comments from parquet files that have C# source code as their content
License
fasterinnerlooper/CommentRemover
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Removes comments from parquet files that have C# source code as their content
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published