VisDA 2022 Challenge: Domain Adaptation for Industrial Waste Sorting

Dina Bashkirova, Samarth Mishra, Diala Lteif, Piotr Teterwak, Donghyun Kim, Fadi Alladkani, James Akl, Berk Calli, Sarah Adel Bargal, Kate Saenko, Daehan Kim, Minseok Seo, YoungJin Jeon, Dong-Geol Choi, Shahaf Ettedgui, Raja Giryes, Shady Abu-Hussein, Binhui Xie, Shuang Li
Proceedings of the NeurIPS 2022 Competitions Track, PMLR 220:104-118, 2022.

Abstract

Label-efficient and reliable semantic segmentation is essential for many real-life applications, especially for industrial settings with high visual diversity, such as waste sorting. In industrial waste sorting, one of the biggest challenges is the extreme diversity of the input stream depending on factors like the location of the sorting facility, the equipment available in the facility, and the time of year, all of which significantly impact the composition and visual appearance of the waste stream. These changes in the data are called “visual domains”, and label-efficient adaptation of models to such domains is needed for successful semantic segmentation of industrial waste. To test the abilities of computer vision models on this task, we present the \emph{VisDA 2022 Challenge on Domain Adaptation for Industrial Waste Sorting}. Our challenge incorporates a fully-annotated waste sorting dataset, ZeroWaste, collected from two real material recovery facilities in different locations and seasons, as well as a novel procedurally generated synthetic waste sorting dataset, SynthWaste. In this competition, we aim to answer two questions: 1) can we leverage domain adaptation techniques to minimize the domain gap? and 2) can synthetic data augmentation improve performance on this task and help adapt to changing data distributions? The results of the competition show that industrial waste detection poses a real domain adaptation problem, that domain generalization techniques such as augmentations, ensembling, etc., improve the overall performance on the unlabeled target domain examples, and that leveraging synthetic data effectively remains an open problem. See \url{https://ai.bu.edu/visda-2022/}

Cite this Paper


BibTeX
@InProceedings{pmlr-v220-bashkirova23a, title = {VisDA 2022 Challenge: Domain Adaptation for Industrial Waste Sorting}, author = {Bashkirova, Dina and Mishra, Samarth and Lteif, Diala and Teterwak, Piotr and Kim, Donghyun and Alladkani, Fadi and Akl, James and Calli, Berk and Bargal, Sarah Adel and Saenko, Kate and Kim, Daehan and Seo, Minseok and Jeon, YoungJin and Choi, Dong-Geol and Ettedgui, Shahaf and Giryes, Raja and Abu-Hussein, Shady and Xie, Binhui and Li, Shuang}, booktitle = {Proceedings of the NeurIPS 2022 Competitions Track}, pages = {104--118}, year = {2022}, editor = {Ciccone, Marco and Stolovitzky, Gustavo and Albrecht, Jacob}, volume = {220}, series = {Proceedings of Machine Learning Research}, month = {28 Nov--09 Dec}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v220/bashkirova23a/bashkirova23a.pdf}, url = {https://proceedings.mlr.press/v220/bashkirova23a.html}, abstract = {Label-efficient and reliable semantic segmentation is essential for many real-life applications, especially for industrial settings with high visual diversity, such as waste sorting. In industrial waste sorting, one of the biggest challenges is the extreme diversity of the input stream depending on factors like the location of the sorting facility, the equipment available in the facility, and the time of year, all of which significantly impact the composition and visual appearance of the waste stream. These changes in the data are called “visual domains”, and label-efficient adaptation of models to such domains is needed for successful semantic segmentation of industrial waste. To test the abilities of computer vision models on this task, we present the \emph{VisDA 2022 Challenge on Domain Adaptation for Industrial Waste Sorting}. Our challenge incorporates a fully-annotated waste sorting dataset, ZeroWaste, collected from two real material recovery facilities in different locations and seasons, as well as a novel procedurally generated synthetic waste sorting dataset, SynthWaste. In this competition, we aim to answer two questions: 1) can we leverage domain adaptation techniques to minimize the domain gap? and 2) can synthetic data augmentation improve performance on this task and help adapt to changing data distributions? The results of the competition show that industrial waste detection poses a real domain adaptation problem, that domain generalization techniques such as augmentations, ensembling, etc., improve the overall performance on the unlabeled target domain examples, and that leveraging synthetic data effectively remains an open problem. See \url{https://ai.bu.edu/visda-2022/}} }
Endnote
%0 Conference Paper %T VisDA 2022 Challenge: Domain Adaptation for Industrial Waste Sorting %A Dina Bashkirova %A Samarth Mishra %A Diala Lteif %A Piotr Teterwak %A Donghyun Kim %A Fadi Alladkani %A James Akl %A Berk Calli %A Sarah Adel Bargal %A Kate Saenko %A Daehan Kim %A Minseok Seo %A YoungJin Jeon %A Dong-Geol Choi %A Shahaf Ettedgui %A Raja Giryes %A Shady Abu-Hussein %A Binhui Xie %A Shuang Li %B Proceedings of the NeurIPS 2022 Competitions Track %C Proceedings of Machine Learning Research %D 2022 %E Marco Ciccone %E Gustavo Stolovitzky %E Jacob Albrecht %F pmlr-v220-bashkirova23a %I PMLR %P 104--118 %U https://proceedings.mlr.press/v220/bashkirova23a.html %V 220 %X Label-efficient and reliable semantic segmentation is essential for many real-life applications, especially for industrial settings with high visual diversity, such as waste sorting. In industrial waste sorting, one of the biggest challenges is the extreme diversity of the input stream depending on factors like the location of the sorting facility, the equipment available in the facility, and the time of year, all of which significantly impact the composition and visual appearance of the waste stream. These changes in the data are called “visual domains”, and label-efficient adaptation of models to such domains is needed for successful semantic segmentation of industrial waste. To test the abilities of computer vision models on this task, we present the \emph{VisDA 2022 Challenge on Domain Adaptation for Industrial Waste Sorting}. Our challenge incorporates a fully-annotated waste sorting dataset, ZeroWaste, collected from two real material recovery facilities in different locations and seasons, as well as a novel procedurally generated synthetic waste sorting dataset, SynthWaste. In this competition, we aim to answer two questions: 1) can we leverage domain adaptation techniques to minimize the domain gap? and 2) can synthetic data augmentation improve performance on this task and help adapt to changing data distributions? The results of the competition show that industrial waste detection poses a real domain adaptation problem, that domain generalization techniques such as augmentations, ensembling, etc., improve the overall performance on the unlabeled target domain examples, and that leveraging synthetic data effectively remains an open problem. See \url{https://ai.bu.edu/visda-2022/}
APA
Bashkirova, D., Mishra, S., Lteif, D., Teterwak, P., Kim, D., Alladkani, F., Akl, J., Calli, B., Bargal, S.A., Saenko, K., Kim, D., Seo, M., Jeon, Y., Choi, D., Ettedgui, S., Giryes, R., Abu-Hussein, S., Xie, B. & Li, S.. (2022). VisDA 2022 Challenge: Domain Adaptation for Industrial Waste Sorting. Proceedings of the NeurIPS 2022 Competitions Track, in Proceedings of Machine Learning Research 220:104-118 Available from https://proceedings.mlr.press/v220/bashkirova23a.html.

Related Material