Hostname: page-component-cb9f654ff-hn9fh Total loading time: 0 Render date: 2025-08-28T01:06:30.110Z Has data issue: false hasContentIssue false
  • English
  • Français

Assessing Machine Learnability of Image and Graph Representations for Drone Performance Prediction

Published online by Cambridge University Press:  26 May 2022

B. Song ,
C. McComb  and
F. Ahmed
B. Song*
Affiliation:
Massachusetts Institute of Technology, United States of America
C. McComb
Affiliation:
Carnegie Mellon University, United States of America
F. Ahmed
Affiliation:
Massachusetts Institute of Technology, United States of America
*
binyangs@mit.edu

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

Deep learning (DL) from various representations have succeeded in many fields. However, we know little about the machine learnability of distinct design representations when using DL to predict design performance. This paper proposes a graph representation for designs and compares it to the common image representation. We employ graph neural networks (GNNs) and convolutional neural networks (CNNs) respectively to learn them to predict drone performance. GCNs outperform CNNs by 2.6-8.1% in predictive validity. We argue that graph learning is a powerful and generalizable method for such tasks.

Keywords

engineering designartificial intelligence (AI)design evaluationdesign representationgraph convolutional networks

Information

Type
Article
Information
Proceedings of the Design Society , Volume 2: DESIGN2022 , May 2022 , pp. 1777 - 1786
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2022.

References

Aleksandrov, D. and Penkov, I. (2012), “Optimal gap distance between rotors of mini quadrotor helicopter”, Proceedings of the International Conference of DAAAM Baltic, pp. 251–255.Google Scholar
Atwood, J. and Towsley, D. (2015), “Diffusion-Convolutional Neural Networks”, Advances in Neural Information Processing Systems, pp. 2001–2009.Google Scholar
Barnes, J.A. and Harary, F. (1983), “Graph theory in network analysis”, Social Networks, Vol. 5 No. 2, pp. 235–244.CrossRefGoogle Scholar
Battaglia, P.W., Hamrick, J.B., Bapst, V., Sanchez-Gonzalez, A., Zambaldi, V., Malinowski, M., Tacchetti, A., et al. . (2018), “Relational inductive biases, deep learning, and graph networks”, https://arxiv.org/abs/1806.01261v3.Google Scholar
Burnap, A., Liu, Y., Pan, Y., Lee, H., Gonzalez, R. and Papalambros, P.Y. (2016), “Estimating and Exploring the Product Form Design Space Using Deep Generative Models”, Proceedings of the ASME Design Engineering Technical Conference, Vol. 2A-2016, 10.1115/DETC2016-60091.Google Scholar
Cao, W., Robinson, T., Hua, Y., Boussuge, F., Colligan, A.R. and Pan, W. (2020), “Graph Representation of 3D CAD Models for Machining Feature Recognition with Deep Learning”, Proceedings of the ASME Design Engineering Technical Conference, Vol. 11A-2020, 10.1115/DETC2020-22355.Google Scholar
Chen, W. and Ahmed, F. (2021), “MO-PaDGAN: Reparameterizing Engineering Designs for augmented multi-objective optimization”, Applied Soft Computing, Vol. 113, p. 107909.CrossRefGoogle Scholar
Daneshmand, M., Helmi, A., Avots, E., Noroozi, F., Alisinanoglu, F., Arslan, H.S., Gorbova, J., et al. . (2018), “3D Scanning: A Comprehensive Survey”, https://arxiv.org/abs/1801.08863v1.Google Scholar
Gao, H., Wang, Z. and Ji, S. (2018), “Large-scale learnable graph convolutional networks”, Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery, Vol. 18, pp. 1416–1424.Google Scholar
Hamilton, W.L., Ying, R. and Leskovec, J. (2017), “Inductive Representation Learning on Large Graphs”, Advances in Neural Information Processing Systems, Neural information processing systems foundation, Vol. 2017, pp. 1025–1035.Google Scholar
Hannah, R., Joshi, S. and Summers, J.D. (2012), “A user study of interpretability of engineering design representations”, Taylor & Francis , Vol. 23 No. 6, pp. 443–468.Google Scholar
He, K., Zhang, X., Ren, S. and Sun, J. (2016), “Deep residual learning for image recognition”, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2016, pp. 770–778.Google Scholar
Huang, G., Liu, Z., Van Der, Maaten, L. and Weinberger, K.Q. (2017), “Densely Connected Convolutional Networks”, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 2017, pp. 2261–2269.CrossRefGoogle Scholar
Khokhlov, M., Koh, I. and Huang, J. (2019), “Voxel Synthesis for Generative Design”, Design Computing and Cognition ’18, Springer International Publishing, pp. 227–244.CrossRefGoogle Scholar
Kipf, T.N. and Welling, M. (2016), “Semi-Supervised Classification with Graph Convolutional Networks”, 5th International Conference on Learning Representations, ICLR 2017.Google Scholar
Krizhevsky, A., Sutskever, I. and Hinton, G.E. (2012), “ImageNet Classification with Deep Convolutional Neural Networks”, Vol. 25, pp. 1–9.Google Scholar
Kulfan, B.M. (2012), “Universal Parametric Geometry Representation Method”, Journal of Air Craft, Vol. 45 No. 1, pp. 142–158.Google Scholar
LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P. (1998), “Gradient-based learning applied to document recognition”, Proceedings of the IEEE, Vol. 86 No. 11, pp. 2278–2323.Google Scholar
Park, J.J., Florence, P., Straub, J., Newcombe, R. and Lovegrove, S. (2019), “DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation”.Google Scholar
Pfaff, T., Fortunato, M., Sanchez-Gonzalez, A., & Battaglia, P. W. (2020). Learning Mesh-Based Simulation with Graph Networks. ArXiv:2010.03409 [Cs.LG].Google Scholar
Regenwetter, L., Nobari, A.H. and Ahmed, F. (2021), “Deep Generative Models in Engineering Design: A Review”, https://arxiv.org/abs/2110.10863v1.Google Scholar
Shi, W., & Rajkumar, R. (2020). Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 1711–1719.Google Scholar
Shuman, D.I., Narang, S.K., Frossard, P., Ortega, A. and Vandergheynst, P. (2013), “The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains”, IEEE Signal Processing Magazine, Vol. 30 No. 3, pp. 83–98.Google Scholar
Simonyan, K. and Zisserman, A. (2014), “Very Deep Convolutional Networks for Large-Scale Image Recognition”, 3rd International Conference on Learning Representations, ICLR.Google Scholar
Song, B., Luo, J. and Wood, K. (2018), “Data-Driven Platform Design: Patent Data and Function Network Analysis”, Journal of Mechanical Design, Vol. 141 No. 2, p. 021101.CrossRefGoogle Scholar
Song, B., Meinzer, E., Agrawal, A. and McComb, C. (2020a), “Topic Modeling and Sentiment Analysis of Social Media Data to Drive Experiential Redesign”, Proceedings of the ASME Design Engineering Technical Conference, Vol. 11A-2020.Google Scholar
Song, B., Soria Zurita, N. F., Nolte, H., Singh, H., Cagan, J., & McComb, C. (2021). When Faced with Increasing Complexity: The Effectiveness of Artificial Intelligence Assistance for Drone Design. Journal of Mechanical Design, 144(2). 10.1115/1.4051871.Google Scholar
Song, B., Soria Zurita, N. F., Zhang, G., Stump, G., Balon, C., Miller, S. W., … McComb, C. (2020b). Toward hybrid teams: a platform to understand human-computer collaboration during the design of complex engineered systems. Proceedings of the Design Society: DESIGN Conference, 1, 1551–1560. 10.1017/dsd.2020.68.Google Scholar
Stump, G.M., Miller, S.W., Yukish, M.A., Simpson, T.W. and Tucker, C. (2019a), “Spatial Grammar-Based Recurrent Neural Network for Design Form and Behavior Optimization”, Journal of Mechanical Design, Vol. 141 No. 12, p. 124501.CrossRefGoogle Scholar
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., et al. . (2015), “Going deeper with convolutions”, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–9.Google Scholar
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. and Wojna, Z. (2016),“ Rethinking the Inception Architecture for Computer Vision”.CrossRefGoogle Scholar
Voulodimos, A., Doulamis, N., Doulamis, A. and Protopapadakis, E. (2018), “Deep Learning for Computer Vision: A Brief Review”, Computational Intelligence and Neuroscience, Vol. 2018, 10.1155/2018/7068349.Google ScholarPubMed
Wen, R., Tang, W. and Su, Z. (2016), “A 2D engineering drawing and 3D model matching algorithm for process plant”, ICVRV 2015, pp. 154–159.Google Scholar
Yang, W., Ding, H., Zi, B. and Zhang, D. (2018), “New Graph Representation for Planetary Gear Trains”, Journal of Mechanical Design, Vol. 140 No. 1.Google Scholar
Zhang, Z., Wang, Y., Jimack, P.K. and Wang, H. (2020), “MeshingNet: A New Mesh Generation Method Based on Deep Learning”, Lecture Notes in Computer Science, Springer, Cham, Vol. 12139 LNCS, pp. 186–198.CrossRefGoogle Scholar
Zhou, J., Cui, G., Hu, S., Zhang, Z., Yang, C., Liu, Z., Wang, L., et al. . (2021), “Graph neural networks: A review of methods and applications”, 10.1016/j.aiopen.2021.01.001.Google Scholar