-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
0 parents
commit 0adebb5
Showing
8 changed files
with
4,181 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,64 @@ | ||
| # MetaVD | ||
|
|
||
| MetaVD is a *Meta Video Dataset* for enhancing human action recognition datasets. | ||
| It provides human-annotated relationship labels between action classes across human action recognition datasets. | ||
| MetaVD is proposed in the following paper: | ||
|
|
||
| **Yuya Yoshikawa, Yutaro Shigeto, and Akikazu Takeuchi. "MetaVD: A Meta Video Dataset for enhancing human action recognition datasets." Computer Vision and Image Understanding 212 (2021): 103276. [[link](https://www.sciencedirect.com/science/article/pii/S107731422100120X)]** | ||
|
|
||
| MetaVD integrates the following datasets: | ||
| - [UCF101](https://www.crcv.ucf.edu/data/UCF101.php) | ||
| - [HMDB51](https://serre-lab.clps.brown.edu/resource/hmdb-a-large-human-motion-database/) | ||
| - [ActivityNet](http://activity-net.org/) | ||
| - [STAIR Actions](https://actions.stair.center/) | ||
| - [Charades](https://prior.allenai.org/projects/charades) | ||
| - [Kinetics-700](https://deepmind.com/research/open-source/kinetics) | ||
|
|
||
| This repository does _NOT_ provide videos in the datasets. | ||
| For information on how to download the videos, please refer to the website of each dataset. | ||
|
|
||
|
|
||
| ## Data Format | ||
| ### Relation label data | ||
| MetaVD relation labels are provided in `metavd_v*.csv`. | ||
| Each row represents an individual relation from an action class, called as _source action class_ to another action class, called as _target action class_. | ||
| The row is composed of the following information. | ||
| - from_dataset (_str_): Dataset name of _source_ action class. Any of `ucf101`, `hmdb51`, `activitynet`, `stair_actions`, `charades`, `kinetics700`. | ||
| - from_action_idx (_int_): Index of _source_ action class. | ||
| - from_action_name (_str_): Name of _source_ action class. | ||
| - to_dataset (_str_): Dataset name of _target_ action class. Any of `ucf101`, `hmdb51`, `activitynet`, `stair_actions`, `charades`, `kinetics700`. | ||
| - to_action_idx (_int_): Index of _target_ action class. | ||
| - to_action_name (_str_): Name of _target_ action class. | ||
| - relation (_str_): Relation type. Any of `equal`, `similar` and `is-a`. | ||
|
|
||
| Relation types `equal` and `similar` are undirected, while only `is-a` is directional. | ||
| Note that, a pair of action classes with any of `equal` and `similar` appears in the file only once. | ||
|
|
||
| ### Action class list | ||
| We provide the list of action classes of each dataset in `[dataset_name]_classes.csv`. | ||
| The 'idx' column corresponds to 'from_action_idx' and 'to_action_idx', and the 'name' column corresponds to 'from_action_name' and 'to_action_name' in relation label data. | ||
|
|
||
| ## Citation | ||
| ```bibtex | ||
| @article{yoshikawa2021metavd, | ||
| title = {MetaVD: A Meta Video Dataset for enhancing human action recognition datasets}, | ||
| journal = {Computer Vision and Image Understanding}, | ||
| volume = {212}, | ||
| pages = {103276}, | ||
| year = {2021}, | ||
| issn = {1077-3142}, | ||
| doi = {https://doi.org/10.1016/j.cviu.2021.103276}, | ||
| url = {https://www.sciencedirect.com/science/article/pii/S107731422100120X}, | ||
| author = {Yuya Yoshikawa and Yutaro Shigeto and Akikazu Takeuchi}, | ||
| keywords = {Human action recognition, Video datasets} | ||
| } | ||
| ``` | ||
|
|
||
| ## License | ||
| MetaVD relation label data (`metavd_v1.csv`) and action class lists (`[dataset_name]_classes.csv`) are licensed under [Creative Commons Attribution 4.0 International license (CC BY 4.0)](https://creativecommons.org/licenses/by/4.0/legalcode). | ||
|
|
||
| ## Acknowledgement | ||
| This dataset is based on results obtained from a project, JPNP20006, commissioned by the New Energy and Industrial Technology Development Organization (NEDO). | ||
|
|
||
| ## Release Notes | ||
| - 1/6/2022: MetaVD is available for download |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,201 @@ | ||
| idx,name | ||
| 0,Applying_sunscreen | ||
| 1,Archery | ||
| 2,Arm_wrestling | ||
| 3,Assembling_bicycle | ||
| 4,BMX | ||
| 5,Baking_cookies | ||
| 6,Ballet | ||
| 7,Bathing_dog | ||
| 8,Baton_twirling | ||
| 9,Beach_soccer | ||
| 10,Beer_pong | ||
| 11,Belly_dance | ||
| 12,Blow-drying_hair | ||
| 13,Blowing_leaves | ||
| 14,Braiding_hair | ||
| 15,Breakdancing | ||
| 16,Brushing_hair | ||
| 17,Brushing_teeth | ||
| 18,Building_sandcastles | ||
| 19,Bullfighting | ||
| 20,Bungee_jumping | ||
| 21,Calf_roping | ||
| 22,Camel_ride | ||
| 23,Canoeing | ||
| 24,Capoeira | ||
| 25,Carving_jack-o-lanterns | ||
| 26,Changing_car_wheel | ||
| 27,Cheerleading | ||
| 28,Chopping_wood | ||
| 29,Clean_and_jerk | ||
| 30,Cleaning_shoes | ||
| 31,Cleaning_sink | ||
| 32,Cleaning_windows | ||
| 33,Clipping_cat_claws | ||
| 34,Cricket | ||
| 35,Croquet | ||
| 36,Cumbia | ||
| 37,Curling | ||
| 38,Cutting_the_grass | ||
| 39,Decorating_the_Christmas_tree | ||
| 40,Disc_dog | ||
| 41,Discus_throw | ||
| 42,Dodgeball | ||
| 43,Doing_a_powerbomb | ||
| 44,Doing_crunches | ||
| 45,Doing_fencing | ||
| 46,Doing_karate | ||
| 47,Doing_kickboxing | ||
| 48,Doing_motocross | ||
| 49,Doing_nails | ||
| 50,Doing_step_aerobics | ||
| 51,Drinking_beer | ||
| 52,Drinking_coffee | ||
| 53,Drum_corps | ||
| 54,Elliptical_trainer | ||
| 55,Fixing_bicycle | ||
| 56,Fixing_the_roof | ||
| 57,Fun_sliding_down | ||
| 58,Futsal | ||
| 59,Gargling_mouthwash | ||
| 60,Getting_a_haircut | ||
| 61,Getting_a_piercing | ||
| 62,Getting_a_tattoo | ||
| 63,Grooming_dog | ||
| 64,Grooming_horse | ||
| 65,Hammer_throw | ||
| 66,Hand_car_wash | ||
| 67,Hand_washing_clothes | ||
| 68,Hanging_wallpaper | ||
| 69,Having_an_ice_cream | ||
| 70,High_jump | ||
| 71,Hitting_a_pinata | ||
| 72,Hopscotch | ||
| 73,Horseback_riding | ||
| 74,Hula_hoop | ||
| 75,Hurling | ||
| 76,Ice_fishing | ||
| 77,Installing_carpet | ||
| 78,Ironing_clothes | ||
| 79,Javelin_throw | ||
| 80,Kayaking | ||
| 81,Kite_flying | ||
| 82,Kneeling | ||
| 83,Knitting | ||
| 84,Laying_tile | ||
| 85,Layup_drill_in_basketball | ||
| 86,Long_jump | ||
| 87,Longboarding | ||
| 88,Making_a_cake | ||
| 89,Making_a_lemonade | ||
| 90,Making_a_sandwich | ||
| 91,Making_an_omelette | ||
| 92,Mixing_drinks | ||
| 93,Mooping_floor | ||
| 94,Mowing_the_lawn | ||
| 95,Paintball | ||
| 96,Painting | ||
| 97,Painting_fence | ||
| 98,Painting_furniture | ||
| 99,Peeling_potatoes | ||
| 100,Ping-pong | ||
| 101,Plastering | ||
| 102,Plataform_diving | ||
| 103,Playing_accordion | ||
| 104,Playing_badminton | ||
| 105,Playing_bagpipes | ||
| 106,Playing_beach_volleyball | ||
| 107,Playing_blackjack | ||
| 108,Playing_congas | ||
| 109,Playing_drums | ||
| 110,Playing_field_hockey | ||
| 111,Playing_flauta | ||
| 112,Playing_guitarra | ||
| 113,Playing_harmonica | ||
| 114,Playing_ice_hockey | ||
| 115,Playing_kickball | ||
| 116,Playing_lacrosse | ||
| 117,Playing_piano | ||
| 118,Playing_polo | ||
| 119,Playing_pool | ||
| 120,Playing_racquetball | ||
| 121,Playing_rubik_cube | ||
| 122,Playing_saxophone | ||
| 123,Playing_squash | ||
| 124,Playing_ten_pins | ||
| 125,Playing_violin | ||
| 126,Playing_water_polo | ||
| 127,Pole_vault | ||
| 128,Polishing_forniture | ||
| 129,Polishing_shoes | ||
| 130,Powerbocking | ||
| 131,Preparing_pasta | ||
| 132,Preparing_salad | ||
| 133,Putting_in_contact_lenses | ||
| 134,Putting_on_makeup | ||
| 135,Putting_on_shoes | ||
| 136,Rafting | ||
| 137,Raking_leaves | ||
| 138,Removing_curlers | ||
| 139,Removing_ice_from_car | ||
| 140,Riding_bumper_cars | ||
| 141,River_tubing | ||
| 142,Rock-paper-scissors | ||
| 143,Rock_climbing | ||
| 144,Rollerblading | ||
| 145,Roof_shingle_removal | ||
| 146,Rope_skipping | ||
| 147,Running_a_marathon | ||
| 148,Sailing | ||
| 149,Scuba_diving | ||
| 150,Sharpening_knives | ||
| 151,Shaving | ||
| 152,Shaving_legs | ||
| 153,Shot_put | ||
| 154,Shoveling_snow | ||
| 155,Shuffleboard | ||
| 156,Skateboarding | ||
| 157,Skiing | ||
| 158,Slacklining | ||
| 159,Smoking_a_cigarette | ||
| 160,Smoking_hookah | ||
| 161,Snatch | ||
| 162,Snow_tubing | ||
| 163,Snowboarding | ||
| 164,Spinning | ||
| 165,Spread_mulch | ||
| 166,Springboard_diving | ||
| 167,Starting_a_campfire | ||
| 168,Sumo | ||
| 169,Surfing | ||
| 170,Swimming | ||
| 171,Swinging_at_the_playground | ||
| 172,Table_soccer | ||
| 173,Tai_chi | ||
| 174,Tango | ||
| 175,Tennis_serve_with_ball_bouncing | ||
| 176,Throwing_darts | ||
| 177,Trimming_branches_or_hedges | ||
| 178,Triple_jump | ||
| 179,Tug_of_war | ||
| 180,Tumbling | ||
| 181,Using_parallel_bars | ||
| 182,Using_the_balance_beam | ||
| 183,Using_the_monkey_bar | ||
| 184,Using_the_pommel_horse | ||
| 185,Using_the_rowing_machine | ||
| 186,Using_uneven_bars | ||
| 187,Vacuuming_floor | ||
| 188,Volleyball | ||
| 189,Wakeboarding | ||
| 190,Walking_the_dog | ||
| 191,Washing_dishes | ||
| 192,Washing_face | ||
| 193,Washing_hands | ||
| 194,Waterskiing | ||
| 195,Waxing_skis | ||
| 196,Welding | ||
| 197,Windsurfing | ||
| 198,Wrapping_presents | ||
| 199,Zumba |
Oops, something went wrong.