SpringerLink
Log in

Generative adversarial networks and hessian locally linear embedding for geometric variations management in manufacturing

  • Published:
Journal of Intelligent Manufacturing Aims and scope Submit manuscript

Abstract

Geometric variations and uncertainty are generally observed on every manufactured workpiece and have a critical influence on the functional performance of mechanical parts. In computer-aided tolerancing, the Skin Model Shapes framework is recognized as a novel paradigm to embed the expected and observed geometric variations of mechanical products based on discrete geometry representation schemes. Currently, the generation of Skin Model Shapes is still limited due to the lack of knowledge-based parameter settings in the design process, and the consideration of enriched simulation and measurement data. In this paper, a novel method based on two distinct techniques, namely Generative Adversarial Networks (GAN) and Hessian Locally Linear Embedding (HLLE), is proposed to generate Skin Model Shapes without any explicitly defined parameters. A Wasserstein GAN structure is trained for generating patterns of geometric deviations based on simulation data. Geometric deviations on planar and cylindrical surfaces are considered in a training process since both types of surfaces are widely used in mechanical engineering. HLLE is used in the paper to extend the implementation of the proposed deviation map** process from planar/cylindrical surfaces to other types of surfaces scattered in 3D space. The proposed Skin Model Shapes generation process enables the efficient generation of part representatives with geometric deviations without the need for extensive deviation modeling. Meanwhile, the proposed method overcomes the common limitation of simulating different types (e.g. rotational and freeform) of non-ideal surfaces on Skin Model Shapes. The implemented case studies show that our method can be used to generate hundreds of distinct Skin Model Shapes within seconds while the distributions of simulated geometric deviations on the surfaces are consistent with the measurement results. Meanwhile, the generated Skin Model Shapes can be used for further applications such as assembly simulation and tolerance analysis to obtain more realistic simulation results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26

Similar content being viewed by others

Data availibility

The data that support the findings of this study are available from the corresponding author, upon reasonable request.

References

  • Ameta, G., Serge, S., & Giordano, M. (2011). Comparison of spatial math models for tolerance analysis: tolerance-maps, deviation domain, and TTRS. Journal of Computing and Information Science in Engineering, 11.

  • An, S., Zheng, B., Shalaginov, M. Y., Tang, H., Li, H., Zhou, L., Ding, J., Agarwal, A. M., Rivero-Baleine, C., & Kang, M. et al. (2020). A freeform dielectric metasurface modeling approach based on deep neural networks. ar**v preprintar**v:2001.00121, .

  • Anwer, N., Schleich, B., Mathieu, L., & Wartzack, S. (2014). From solid modelling to skin model shapes: Shifting paradigms in computer-aided tolerancing. CIRP Annals, 63, 137–140.

    Article  Google Scholar 

  • Arjovsky, M., & Bottou, L. (2017). Towards principled methods for training generative adversarial networks. ar**v preprintar**v:1701.04862, .

  • Arjovsky, M., Chintala, S., & Bottou, L. (2017). Wasserstein generative adversarial networks. In International conference on machine learning (pp. 214–223). PMLR.

  • Arwade, S. R. (2011). Computational analysis of randomness in structural mechanics.

  • Bourdet, P., Mathieu, L., Lartigue, C., & Ballu, A. (1995). The concept of the small displacement torsor in metrology, proceeding of international euro conference advanced mathematical tools in metrology.

  • Budninskiy, M., Liu, B., Tong, Y., & Desbrun, M. (2017). Spectral affine-kernel embeddings. In Computer Graphics Forum (pp. 117–129). Wiley Online Library volume 36.

  • Cai, N., Anwer, N., Scott, P. J., Qiao, L., & Jiang, X. (2020). A new partitioning process for geometrical product specifications and verification. Precision Engineering, 62, 282–295.

    Article  Google Scholar 

  • Claus, F., Hamann, B., Leitte, H., & Hagen, H. (2021). Decomposing deviations of scanned surfaces of sheet metal assemblies. Journal of Manufacturing Systems, 61, 125–138.

    Article  Google Scholar 

  • Creswell, A., White, T., Dumoulin, V., Arulkumaran, K., Sengupta, B., & Bharath, A. A. (2018). Generative adversarial networks: An overview. IEEE Signal Processing Magazine, 35, 53–65.

    Article  Google Scholar 

  • Croquelois, M. (2021). Évolution de l’industrialisation par l’exploitation des données de production dans un contexte industriel. Ph.D. thesis université Paris-Saclay.

  • Dantan, J.-Y., & Qureshi, A.-J. (2009). Worst-case and statistical tolerance analysis based on quantified constraint satisfaction problems and monte carlo simulation. Computer-Aided Design, 41, 1–12.

    Article  Google Scholar 

  • Denton, E., Gross, S., & Fergus, R. (2016). Semi-supervised learning with context-conditional generative adversarial networks. ar**v preprintar**v:1611.06430, .

  • Donoho, D. L., & Grimes, C. (2003). Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data. Proceedings of the National Academy of Sciences of the United States of America, 100, 5591–5596.

    Article  Google Scholar 

  • Eastwood, J., Newton, L., Leach, R., & Piano, S. (2022). Generation and categorisation of surface texture data using a modified progressively growing adversarial network. Precision Engineering, 74, 1–11.

    Article  Google Scholar 

  • Gelfand, N., & Guibas, L. J. (2004). Shape segmentation using local slippage analysis. In Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing (pp. 214–223).

  • Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020). Generative adversarial networks. Communications of the ACM, 63, 139–144.

    Article  Google Scholar 

  • Grandjean, J., Ledoux, Y., & Samper, S. (2013). On the role of form defects in assemblies subject to local deformations and mechanical loads. The International Journal of Advanced Manufacturing Technology, 65, 1769–1778.

    Article  Google Scholar 

  • Grandjean, J., Ledoux, Y., Samper, S., & Favreliere, H. (2013). Form errors impact in a rotating plane surface assembly. Procedia Cirp, 10, 178–185.

    Article  Google Scholar 

  • Hao, R., Lu, B., Cheng, Y., Li, X., & Huang, B. (2021). A steel surface defect inspection approach towards smart industrial monitoring. Journal of Intelligent Manufacturing, 32, 1833–1843.

    Article  Google Scholar 

  • Homri, L., Teissandier, D., & Ballu, A. (2015). Tolerance analysis by polytopes: Taking into account degrees of freedom with cap half-spaces. Computer-Aided Design, 62, 112–130.

    Article  Google Scholar 

  • Homri, L., Goka, E., Levasseur, G., & Dantan, J.-Y. (2017). Tolerance analysis-form defects modeling and simulation by modal decomposition and optimization. Computer-Aided Design, 91, 46–59.

    Article  Google Scholar 

  • Huang, W., & Ceglarek, D. (2002). Mode-based decomposition of part form error by discrete-cosine-transform with implementation to assembly and stam** system with compliant parts. CIRP Annals, 51, 21–26.

    Article  Google Scholar 

  • ISO. (2021). Geometrical product specifications (GPS) -Partitioning -Part 3: Methods used for Specification and Verification. ISO,18183–3, 2021.

  • ISO. (2011). Geometrical product specifications (gps) - general concepts - part 1: Model for geometrical specifications and verification. ISO, 17450–1, 2011.

    Google Scholar 

  • ISO. (2017). Geometrical product specifications (GPS)-Geometrical tolerancing-Tolerances of form, orientation, location and run-out. ISO, 1101, 2017.

    Google Scholar 

  • Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2017). Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1125–1134).

  • Jain, S., Seth, G., Paruthi, A., Soni, U., & Kumar, G. (2020). Synthetic data augmentation for surface defect detection and classification using deep learning. Journal of Intelligent Manufacturing, (pp. 1–14).

  • Koenderink, J. J., & Van Doorn, A. J. (1992). Surface shape and curvature scales. Image and vision computing, 10, 557–564.

    Article  Google Scholar 

  • Ledoux, Y., Samper, S., & Grandjean, J. (2016). Integrating form defects of mechanical joints into the tolerance studies. Adv. Math. Comput. Sci. Their Appl., Venice, Italy: WSEAS Press, .

  • Lindau, B., Lindkvist, L., Andersson, A., & Söderberg, R. (2013). Statistical shape modeling in virtual assembly using pca-technique. Journal of Manufacturing Systems, 32, 456–463.

    Article  Google Scholar 

  • Liu, Y.-S., & Ramani, K. (2009). Robust principal axes determination for point-based shapes using least median of squares. Computer-Aided Design, 41, 293–305.

    Article  Google Scholar 

  • Liu, J., Zhang, Z., Ding, X., & Shao, N. (2018). Integrating form errors and local surface deformations into tolerance analysis based on skin model shapes and a boundary element method. Computer-Aided Design, 104, 45–59.

    Article  Google Scholar 

  • Liu, L., Cao, D., Wu, Y., & Wei, T. (2019). Defective samples simulation through adversarial training for automatic surface inspection. Neurocomputing, 360, 230–245.

    Article  Google Scholar 

  • Luo, J., Huang, J., & Li, H. (2021). A case study of conditional deep convolutional generative adversarial networks in machine fault diagnosis. Journal of Intelligent Manufacturing, 32, 407–425.

    Article  Google Scholar 

  • Mao, X., Li, Q., **e, H., Lau, R. Y., Wang, Z., & Paul Smolley, S. (2017). Least squares generative adversarial networks. In Proceedings of the IEEE international conference on computer vision (pp. 2794–2802).

  • Odena, A., Olah, C., & Shlens, J. (2017). Conditional image synthesis with auxiliary classifier gans. In International conference on machine learning (pp. 2642–2651). PMLR.

  • Oliver, M. A., & Webster, R. (1990). Kriging: a method of interpolation for geographical information systems. International Journal of Geographical Information System, 4, 313–332.

    Article  Google Scholar 

  • Qie, Y., & Anwer, N. (2021). Toward non-default partitioning for compound feature identification in engineering design. Procedia CIRP, 100, 852–857.

    Article  Google Scholar 

  • Qie, Y., Bickel, S., Wartzack, S., Schleich, B., & Anwer, N. (2021). A function-oriented surface reconstruction framework for reverse engineering. CIRP Annals, 70, 135–138.

    Article  Google Scholar 

  • Qie, Y., Qiao, L., & Anwer, N. (2021). Enhanced invariance class partitioning using discrete curvatures and conformal geometry. Computer-Aided Design, 133, 102985.

    Article  Google Scholar 

  • Radford, A., Metz, L., & Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. ar**v preprintar**v:1511.06434, .

  • Radhakrishnan, S., Bharadwaj, V., Manjunath, V., & Srinath, R. (2018). Creative intelligence–automating car design studio with generative adversarial networks (gan). In International Cross-Domain Conference for Machine Learning and Knowledge Extraction (pp. 160–175). Springer.

  • Roweis, S. T., & Saul, L. K. (2000). Nonlinear dimensionality reduction by locally linear embedding. science, 290, 2323–2326.

  • Samper, S., & Formosa, F. (2007). Form defects tolerancing by natural modes analysis. Journal of Computing and Information Science in Engineering, 007, 44.

    Article  Google Scholar 

  • Schindlbeck, C., Pape, C., & Reithmeier, E. (2018). Predictor-corrector framework for the sequential assembly of optical systems based on wavefront sensing. Optics express, 26, 10669–10681.

    Article  Google Scholar 

  • Schleich, B., & Wartzack, S. (2017). Challenges of geometrical variations modelling in virtual product realization. Procedia CIRP, 60, 116–121.

    Article  Google Scholar 

  • Schleich, B., Anwer, N., Mathieu, L., & Wartzack, S. (2014). Skin model shapes: A new paradigm shift for geometric variations modelling in mechanical engineering. Computer-Aided Design, 50, 1–15.

    Article  Google Scholar 

  • Schleich, B., Qie, Y., Wartzack, S., & Anwer, N. (2022). Generative adversarial networks for tolerance analysis. CIRP Annals, 71, 133–136.

    Article  Google Scholar 

  • Shamir, A. (2008). A survey on mesh segmentation techniques. In Computer graphics forum (pp. 1539–1556). Wiley Online Library volume 27.

  • Sun, T.-H., Tien, F.-C., Tien, F.-C., & Kuo, R.-J. (2016). Automated thermal fuse inspection using machine vision and artificial neural networks. Journal of Intelligent Manufacturing, 27, 639–651.

    Article  Google Scholar 

  • Tenenbaum, J.B., De Silva, V., & Langford, J.C. (2000). A global geometric framework for nonlinear dimensionality reduction. science, 290, 2319–2323.

  • Wagersten, O., Lindau, B., Lindkvist, L., & Söderberg, R. (2014). Using morphing techniques in early variation analysis. Journal of Computing and Information Science in Engineering, 14.

  • Wang, J., Ma, Y., Zhang, L., Gao, R. X., & Wu, D. (2018). Deep learning for smart manufacturing: Methods and applications. Journal of manufacturing systems, 48, 144–156.

    Article  Google Scholar 

  • Wang, Z., Wang, J., & Wang, Y. (2018). An intelligent diagnosis scheme based on generative adversarial learning deep neural networks and its application to planetary gearbox fault pattern recognition. Neurocomputing, 310, 213–222.

    Article  Google Scholar 

  • Wilma, P., & Giovanni, M. (2015). Manufacturing signature for tolerance analysis. Journal of Computing and Information Science in Engineering, 15.

  • Wu, J., Qiao, L., & Huang, Z. (2018). Deviation modeling of manufactured surfaces from a perspective of manufacturing errors. The International Journal of Advanced Manufacturing Technology, 98, 1321–1337.

    Article  Google Scholar 

  • Wu, J., Qiao, L., Zhu, Z., & Anwer, N. (2019). A novel representation method of non-ideal surface morphologies and its application in shaft-hole sealing simulation analysis. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, 233, 575–587.

  • Yan, X., & Ballu, A. (2017). Generation of consistent skin model shape based on fea method. International Journal of Advanced manufacturing technology, 92.

  • Yan, X., & Ballu, A. (2019). Review and comparison of form error simulation methods for computer-aided tolerancing. Journal of Computing and Information Science in Engineering, 19.

  • Yan, X., & Ballu, A. (2018). Tolerance analysis using skin model shapes and linear complementarity conditions. Journal of Manufacturing Systems, 48, 140–156.

    Article  Google Scholar 

  • Zhang, M. (2011). Discrete shape modeling for geometrical product specification: contributions and applications to skin model simulation. Ph.D. thesis École normale supérieure de Cachan-ENS Cachan.

  • Zhang, Z., & Wang, J. (2006). Mlle: Modified locally linear embedding using multiple weights. Advances in neural information processing systems, 19.

  • Zhang, M., Anwer, N., Mathieu, L., & Zhao, H. (2011). A discrete geometry framework for geometrical product specifications. In Proceedings of the 21st CIRP Design Conference, Kaist, MK Thompson, ed., Paper 20.

  • Zhang, Z., & Zha, H. (2004). Principal manifolds and nonlinear dimensionality reduction via tangent space alignment. SIAM journal on scientific computing, 26, 313–338.

    Article  Google Scholar 

  • Zhang, M., Anwer, N., Stockinger, A., Mathieu, L., & Wartzack, S. (2013). Discrete shape modeling for skin model representation. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, 227, 672–680.

    Article  Google Scholar 

  • Zhu, Z., Anwer, N., Huang, Q., & Mathieu, L. (2018). Machine learning in tolerancing for additive manufacturing. CIRP Annals, 67, 157–160.

    Article  Google Scholar 

  • Zhu, Z., Ferreira, K., Anwer, N., Mathieu, L., Guo, K., & Qiao, L. (2020). Convolutional neural network for geometric deviation prediction in additive manufacturing. Procedia CIRP, 91, 534–539.

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank the editors and reviewers for hel** improve this article.

Author information

Authors and Affiliations

  1. Université Paris-Saclay, ENS Paris-Saclay, LURPA, 91190, Gif-sur-Yvette, France

    Yifan Qie & Nabil Anwer

  2. Product Life Cycle Management, Technical University of Darmstadt, Otto-Berndt-Straße 2, 64287, Darmstadt, Germany

    Benjamin Schleich

Authors
  1. Yifan Qie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Benjamin Schleich
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nabil Anwer
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

YQ: Conceptualization, Methodology, Software, Formal analysis, Investigation, Writing - original draft preparation. BS: Conceptualization, Formal analysis, Writing - review and editing. NA: Conceptualization, Methodology, Supervision, Formal analysis, Writing - review and editing.

Corresponding author

Correspondence to Yifan Qie.

Ethics declarations

Competing interests

No potential conflict of interest was reported by the author.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qie, Y., Schleich, B. & Anwer, N. Generative adversarial networks and hessian locally linear embedding for geometric variations management in manufacturing. J Intell Manuf (2023). https://doi.org/10.1007/s10845-023-02284-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10845-023-02284-0

Keywords

Search

Navigation