SpringerLink
Log in

A generative adversarial active learning method for mechanical layout generation

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Layout generation is frequently encountered in the field of mechanical design. The direct application of generative adversarial network, which was originally used to generate pixel-level images, usually cannot guarantee the interrelation between components such as the non-overlap requirement. In addition, the number and the size of components cannot be precisely controlled. These all constitute the characteristics of mechanical layout. To address the above problems, we propose a hierarchical layout generation generative adversarial network (LGGAN) for mechanical layout generation. The layout generator consists of three modules. The first is hierarchical layout generation, where the shape and distribution of components are generated separately using two neural networks. Such a hierarchical structure greatly improves the generation capacity. To reduce the accumulated noise when multiple components are added, a denoiser is included as the second module. The third module is a refinement step used to fine-tune the layouts, which adjusts the size of each component to the prescribed value. All of the three modules are neural network-based, and can be trained through backpropagation. Additionally, an active learning strategy for training the LGGAN is proposed, which allows LGGAN to converge with a small amount of training data in situations where getting a significant amount of training data is not possible. Quantitative and qualitative experiments demonstrate the effectiveness of LGGAN.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data availability

The datasets generated during the current study are available on reasonable request.

References

  1. Lee HY, Jiang L, Essa I, Le PB, Gong H, Yang MH, and Yang W (2020) Neural design network: graphic layout generation with constraints. In: Proceedings of the European conference on computer vision, ECCV , pp 491–506. https://doi.org/10.1007/978-3-030-58580-8_29

  2. Arroyo DM, Postels J, and Tombari F (2021) Variational transformer networks for layout generation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, CVPR, pp 13642–13652. https://doi.org/10.1109/cvpr46437.2021.01343

  3. Jyothi AA, Durand T, He J, Sigal L, Mori G (2019) Layoutvae: stochastic scene layout generation from a label set. In: Proceedings of the IEEE/CVF international conference on computer vision, ICCV, pp 9895–9904. https://doi.org/10.1109/iccv.2019.00999

  4. Shiripour M, Dayama NR, and Oulasvirta A (2021) Grid-based genetic operators for graphical layout generation. In: Proceedings of the ACM on human–computer interaction, pp 1–30. https://doi.org/10.1145/3461730

  5. Li J, Yang J, Zhang J, Liu C, Wang C, Xu T (2020) Attribute-conditioned layout gan for automatic graphic design. IEEE Trans Vis Comput Gr. https://doi.org/10.1109/tvcg.2020.2999335

    Article  Google Scholar 

  6. Qian C, Tan RK, and Ye W (2022) An adaptive artificial neural network-based generative design method for layout designs. Int J Heat Mass Tran, 184(122313). https://doi.org/10.1016/j.ijheatmasstransfer.2021.122313

  7. Tan RK, Zhang N, Ye W (2020) A deep learning–based method for the design of microstructural materials. Struct Multidiscip Optim 61(4):1417–1438. https://doi.org/10.1007/s00158-019-02424-2

    Article  MathSciNet  Google Scholar 

  8. Arjovsky M, Chintala S, Bottou L (2017) Wasserstein gan. ar** material using vibration energy-based finite element analysis method. J Sound Vib, 504(116117). https://doi.org/10.1016/j.jsv.2021.116117

  9. Mehri M, Amini A (2020) Stochastic EMI noise model of PCB layout for circuit-level analysis of system in IoT applications. IEEE Trans Microw Theory 68(12):5072–5081. https://doi.org/10.1109/tmtt.2020.3017223

    Article  Google Scholar 

  10. Liu Z, Ding H, Zhong H, Li W, Dai J, He C (2021) Influence selection for active learning. In: Proceedings of the IEEE/CVF international conference on computer vision, ICCV, pp. 9274–9283. https://doi.org/10.1109/iccv48922.2021.00914

  11. Schellekens W, Thio M, Badde S, Winawer J, Ramsey N, Petridou N (2021) A touch of hierarchy: population receptive fields reveal fingertip integration in Brodmann areas in human primary somatosensory cortex. Brain Struct Funct, pp 1–14. https://doi.org/10.1007/s00429-021-02309-5

  12. Yang H, Chen W, Pathak P, Gennari F, Lai YC, Yu B (2019) Automatic layout generation with applications in machine learning engine evaluation. In: 2019 ACM/IEEE 1st workshop on machine learning for CAD, pp 1–6. https://doi.org/10.1109/mlcad48534.2019.9142121

  13. Jain S, Gea HC (1996) PCB layout design using a genetic algorithm. J Electron Packaging 118(1):11–15. https://doi.org/10.1115/1.2792119

    Article  Google Scholar 

  14. Damera-Venkata N, Bento J, O'Brien-Strain E (2011) Probabilistic document model for automated document composition. In: Proceedings of the 11th ACM symposium on document engineering, pp 3–12. https://doi.org/10.1145/2034691.2034695

  15. Yang YL, Wang J, Vouga E, Wonka P (2013) Urban pattern: layout design by hierarchical domain splitting. ACM Trans Graphic 32(6):1–12. https://doi.org/10.1145/2508363.2508405

    Article  Google Scholar 

  16. Han J, Bae W, Chang E, Wang Z, Nikolić B, Alon E (2021) LAYGO: a template-and-grid-based layout generation engine for advanced CMOS technologies. IEEE Trans Circuits-I 68(3):1012–1022. https://doi.org/10.1109/tcsi.2020.3046524

    Article  Google Scholar 

  17. Para W, Guerrero P, Kelly T, Guibas LJ, Wonka P (2021) Generative layout modeling using constraint graphs. In: Proceedings of the IEEE/CVF international conference on computer vision, pp 6690–6700. https://doi.org/10.1109/iccv48922.2021.00662

  18. Kaveh A, Laknejadi K (2013) A hybrid evolutionary graph-based multi-objective algorithm for layout optimization of truss structures. Acta Mech 224(2):343–364. https://doi.org/10.1007/s00707-012-0754-5

    Article  MathSciNet  MATH  Google Scholar 

  19. Beheshti Z, Shamsuddin SMH (2013) A review of population-based meta-heuristic algorithms. Int J Adv Soft Comput Appl 5(1):1–35

    Google Scholar 

  20. Zhao C, **ang S, Wang Y, et al (2022) Context-aware network fusing transformer and V-Net for semi-supervised segmentation of 3D left atrium. Expert Syst Appl, 119105. https://doi.org/10.1016/j.eswa.2022.119105

  21. Wen L, Zhu Y. Ye L, Chen G, et al (2022) LayouTransformer: generating layout patterns with transformer via sequential pattern modeling. In: Proceedings of the 41st IEEE/ACM international conference on computer-aided design, pp. 1–9. https://doi.org/10.1145/3508352.3549350

  22. Chu H, Li D, Acuna D, Kar A, Shugrina M, Wei X, Fidler S (2019) Neural turtle graphics for modeling city road layouts. In: Proceedings of the IEEE/CVF international conference on computer vision, ICCV, pp 4522–4530. https://doi.org/10.1109/iccv.2019.00462

  23. Chattopadhyay A, Zhang X, Wipf D P, Arora H, Vidal R (2023) Learning graph variational autoencoders with constraints and structured priors for conditional indoor 3D scene generation. In: Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp 785–794

  24. Nauata N, Chang KH, Cheng CY, Mori G, and Furukawa Y (2020) House-gan: relational generative adversarial networks for graph-constrained house layout generation. In: European conference on computer vision, pp 162–177. https://doi.org/10.1007/978-3-030-58452-8_10

  25. Kong Q, Tong B, Klinkigt M, Watanabe Y, Akira N, Murakami T (2019) Active generative adversarial network for image classification. In: Proceedings of the AAAI conference on artificial intelligence, 33(1): 4090–4097. https://doi.org/10.1609/aaai.v33i01.33014090

  26. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Bengio Y (2014) Generative adversarial networks. In: Proceedings of the advances in neural information processing systems

  27. Abdelhamed A, Afifi M, Timofte R, Brown MS (2020) Ntire 2020 challenge on real image denoising: Dataset, methods and results. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 496–497

  28. Abdelhamed A, Timofte R, Brown MS (2019) Ntire 2019 challenge on real image denoising: methods and results. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops

  29. Duan K, Bai S, **e L, Qi H, Huang Q, Tian Q (2019) Centernet: keypoint triplets for object detection. In: Proceedings of the IEEE/CVF international conference on computer vision, ICCV, pp 6569–6578. https://doi.org/10.1109/iccv.2019.00667

  30. Joshi A, Cho M, Shah V, Pokuri B, Sarkar S, Ganapathysubramanian B, Hegde C (2020) InvNet: encoding geometric and statistical invariances in deep generative models. In: Proceedings of the AAAI conference on artificial intelligence, AAAI, 34(04), pp 4377-4384. https://doi.org/10.1609/aaai.v34i04.5863

  31. Ahmad N, Derrible S, Eason T, and Cabezas H (2016) Using fisher information to track stability in multivariate systems. R Soc Open Sci 3(11). https://doi.org/10.1098/rsos.160582

  32. Zheng Z, Wang P, Liu W, Li J, Ye R, Ren D (2020) Distance-IoU loss: faster and better learning for bounding box regression. In: Proceedings of the AAAI conference on artificial intelligence, 34(7):12993–13000. https://doi.org/10.1609/aaai.v34i07.6999

  33. Liu Y, Li Z, Zhou C, Jiang Y, Sun J, Wang M, He X (2019) Generative adversarial active learning for unsupervised outlier detection. IEEE Trans Knowl Data Eng 32(8):1517–1528. https://doi.org/10.1109/TKDE.2019.2905606

    Article  Google Scholar 

  34. Gautam D, Wager D, Musavi F, Edington M, Eberle W, Dunford W G (2013) A review of thermal management in power converters with thermal vias. In: 2013 Twenty-eighth annual IEEE applied power electronics conference and exposition (APEC), pp 627–632. https://doi.org/10.1109/APEC.2013.6520276

  35. Kvashnin VI, Dudina DV, Ukhina AV, Koga GY, Georgarakis K (2022) The benefit of the glassy state of reinforcing particles for the densification of aluminum matrix composites. J Compos Sci 6(5):135. https://doi.org/10.3390/jcs6050135

    Article  Google Scholar 

  36. Kammoun A, Slama R, Tabia H, Ouni T, Abid M (2022) Generative adversarial networks for face generation: a survey. ACM Comput Surv. https://doi.org/10.1145/3527850

    Article  Google Scholar 

  37. Zaidi SSA, Ansari MS, Aslam A, Kanwal N, Asghar M, Lee B (2022) A survey of modern deep learning based object detection models. Digital Signal Process, 103514. https://doi.org/10.1016/j.dsp.2022.103514

Download references

Acknowledgements

This work is supported by the Hong Kong Research Grants under Competitive Earmarked Research Grant No. 16206320.

Author information

Authors and Affiliations

  1. Department of Mechanical and Aerospace Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong

    Kangjie Li & Wen**g Ye

Authors
  1. Kangjie Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wen**g Ye
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wen**g Ye.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interest. The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, K., Ye, W. A generative adversarial active learning method for mechanical layout generation. Neural Comput & Applic 35, 19315–19335 (2023). https://doi.org/10.1007/s00521-023-08751-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-08751-2

Keywords

Search

Navigation