Semiotic and Phenomenological Study of Sacred Architecture Using Last-Generation Eye-Tracking Instrumentation in Real Conditions vs. AI-based Predictions

Julio Bermudez,1 Yoshio Nakamura,2 Ann Sussman,3 Robin Puttock,4 Amir Ebadi,5 Megan Davey,6 and Juliana Keagle1

1 Catholic University of America, 2 University of Utah, 3 The Human Architecture + Planning Institute, Inc, 4 Kennesaw State University, 5 Delustration Design, 6 GTM Architects.

Corresponding author: bermudez@cua.edu  

Keywords: science, aesthetics, sacred space, empirical work, phenomenology, neuroscience, church

Sacred buildings work as pedagogic devices to transmit religious understanding and access spiritual reality. It is this double function that guarantees communal and personal spiritual continuity and growth. In this process, aesthetics has always played a decisive role. Long ago, builders of hallowed structures learned and applied the simple truth that, as Plato articulated 2,500 years ago, we are attracted to, fall in love with, and want to know more about and share that which we find beautiful. If, on the one hand, most scholars and architects would agree with these insights, on the other hand, there is much less agreement about how architecture manages to deliver such results.

For example, among the many competing explanations are those from Theological aesthetics. [1] Scholars in this area have been examining and offering insights about the communicational (semiotic) and experiential (phenomenological) power of the sacred arts for a long time, often focusing on architecture as the writings of Abbot Suger (1140s), Thomas Aquinas (1260s), Rudolf Otto (1970), John Paul II (1999), and Ratzinger (2019) attest.[2]  Over the last two decades, this inquiry has been enriched by work coming from other disciplines.[3] Yet, these studies provide little information about what and how concrete architectural features enable the communication of spiritual understanding.[4] Arguably, architects have gone the furthest in this regard. Using case studies, architectural history, and typological analysis, they have identified architectural properties that effectively transmit spiritual understanding.[5] The problem is how one decides which one(s) of these alternative explanations is correct or, at least, closer to what is really happening. Moving forward necessitates some “objective” method to evaluate any given claim; and for this, there is arguably no better path than a reasonable and cautioned deployment of empirically-grounded means of investigation. In fact, it is because all the existing explanations have been based on indirect means to support their claims (e.g., surveys and behavioral observations at best – see [6]), making it difficult to move forward. Similar limitations afflicted the semiotic investigations of architecture of the 1970s and 80s [7] and more recent narrative/phenomenological studies of buildings.[8]  At the same time, not all empirical work with relevance to sacred architecture has been helpful as the efforts have fallen short because they are too narrow,[9]  too general,[10]  or too focused on effects and not causes.[11] In other words, a carefully designed research agenda is necessary for real progress. The good news is that there have been significant developments in mobile eye-tracking technology and AI (Artificial Intelligence) that open unprecedented opportunities to gain an empirical understanding of how sacred architecture engages people and communicates.  

This paper reports on research intending to address this whole situation by mapping the aesthetic interactions between architecture and human behavior/cognition by applying those cutting-edge instruments to:

  1. identify how architectural features encode aesthetic quality and facilitate both aesthetic reaction and spiritual insights;
  2. determine how this process occurs both semiotically and phenomenologically;
  3. gauge the kinds and levels of cognitive-aesthetic outcomes; and 
  4. elucidate the special aesthetic/cognitive dimensions of architecture.

We are guided by a theoretical framework that establishes sacred buildings as (a) utilizing specific architectural features to (b) encode and communicate spiritual reality and understandings (as information, orientation, and rituals [12]) and that postulates that those features and how we engage them are grounded (c) on “pre-cognitive” mental structures that foreshadow our conscious aesthetic and cognitive response. [13] 

Specifically, we deployed ambulatory eye-tracking (ViewPoint System, VPS 19), AI-based scene analysis (3M VAS, Visual Attention Software), biosensors (Empatica E4 wristband), and questionnaires to gauge, document, and analyze how two different buildings (one religious and one secular) communicated spiritual and other understandings to 32 individuals of Catholic faith. Whereas eye-tracking has been used in laboratory settings to study architecture and urbanism in the past, to our knowledge, this is the first time that an ecological experimental paradigm (i.e., one situated in real life conditions) has been deployed on sacred architecture and one of very few in architecture and urbanism in general. Our presentation will share this unique scientific effort and study methodology as well as its results. Of particular interest will be the comparison between AI-based predictions of how people “should” perceive the architectural scenes and the actual, ecologically situated results from actual people visiting the buildings. Lastly, since this interdisciplinary work is related to another study using neuroscience and biometrics to measure the architectural effects of the same two buildings on devoted Catholics, [14] we will be able to explore the correspondence between architectural causes and effects at an unprecedented empirical level.

Figure 1: one of the research subjects wearing the mobile eye-tracking system while visiting the sacred space.

Figure 2: Mobile eye-tracking results inside the sacred building. Colors map high (red), medium (yellow), and lower (green) levels of visual attention that were statistically calculated across the 32 subjects that visited the building.

Screenshot

Figure 3: AI-based scene analysis. Color mapping is similar to the above, with blue standing for the lowest levels of attention. This study uses no subjects but is purely algorithmic.


Full References

[1] Seasoltz, 2005; Thiessen, 2004; Viladesau, 1999; von Balthazar, 1983-1989.

[2] Aquinas, c.1260s; John Paul II, 1999; Suger, c.1140s; Otto, 1970; Ratzinger, 2019.

[3] Bergmann, 2012; Bermudez, 2015; Hejduk & Williamson, 2011; Jaeger 2010.

[4] Daelemans, 2015; Kieckhefer, 2004; Lukken & Searle, 1993; Thomas, 1994; Wuerl & Aquilina, 2013.

[5] Alexander, 1977, 1979; Ardalan et al., 2014; Lawlor, 1994; Mann, 1993; Schwarz, 1958; Stegers, 2008.

[6] Bermudez, 2009, 2011; Levi & Kocher 2012; Ouellette et al., 2005.

[7] Broadbent et al., 1980; Eco, 1986; Hillier & Hanson, 1984; Preziosi, 1979; Williams Robinson, 2006.

[8] Austin, 2020; Lawson, 2001; Psarra, 2009.

[9] Arnheim, 2009; Goh et al., 2010; Vartanian et al., 2015.

[10] Arbib, 2022; Manzo & Devine-Wright, 2013; Ritchie, 2020.

[11] Bermudez et.al., 2017; Herzog et al., 2010; Hollander & Anderson, 2020.

[12] Jones, 2000.

[13] Cosmides & Tooby, 1997; Hildebrand, 1999; Kellert, 2018; Sussman & Hollander, 2021. This claim is also supported in Chomskyan linguistics, Jungian psychoanalysis, and Wilberian integral psychology.

[14] Bermudez & Nakamura, 2023.

Full References

Alexander, C. The Timeless Way of Building. New York: Oxford University Press, 1979

Alexander, C; Ishikawa, S.; Silverstein, M; Jacobson, M.; Fiksdahl-King, I; & Angel, S. A Pattern Language. Towns, Buildings, Construction. New York: Oxford University Press, 1977.

Aquinas, T. Summa Theologiae, circa 1260s. URL: https://aquinas101.thomisticinstitute.org/st-index (accessed May 1, 2024) 

Arbib, M. A.  When Brains Meet Buildings: A Conversation Between Neuroscience and Architecture. New York: Oxford University Press, 2022.

Ardalan, N.; Bermudez, J.; Chandavarkar, P.; Snyder, A.; & Tabb, P. “Transcendent Architecture. A Pilot Study of Works, Conditions & Practices,” work presented at the ACSF 6th Annual Symposium in Trinity College, Toronto, Canada. Abstract available at URL: http://www.acsforum.org/symposium2014/papers/ARDALAN-ET-AL.pdf (accessed May 1, 2024)

Arnheim, R. The Dynamics of Architectural Form. Berkeley, CA: The University of California Press, 2009.

Austin, T. (2020) Narrative Environment and Experience Design. Space as a Medium of Communication. New York: Routledge

Bergmann, S. Theology in Built Environments. New Brunswick, NJ: Transaction Publishers., 2012.

Bermudez, J. “Amazing Grace. New Research into ‘Extraordinary Architectural Experiences’ Reveals the Central Role of Sacred Places.” Faith & Form, 2009, 42(3), 8-13.

Bermudez, J. “Empirical Aesthetics: The Body and Emotion in Extraordinary Architectural Experiences.” In P. Plowright & B. Gamper (Eds.), Proceedings of the 2011 Architectural Research Centers Consortium Conference. Lawrence Tech University, Detroit, MI, USA, 2011, pp. 369-380.

Bermudez, J. Transcending Architecture. Contemporary Views of Sacred Space. Washington, DC: CUA Press, 2015.

Bermudez, J; Krizaj, D., Lipschitz, D.L.., Bueler, C.E.,Rogowska, J., Yurgelun-Todd, D., & Nakamura, Y. “Externally-induced meditative states: an exploratory fMRI study of architects’ responses to contemplative architecture.” Frontiers of Architectural Research, 2017, 6(2), 123-136. DOI: 10.1016/j.foar.2017.02.002 

Bermudez, J. and Nakamura, Y. “Applying Neurophenomenology to Investigate Responses to Sacred vs. Secular Architecture: An Exploratory Study.” In Presenters Abstracts of the 20th Anniversary ANFA Conference. La Jolla, CA: ANFA (Sept. 13-16, 2023) URL: https://anfarch.org/events/2023conference 

Broadbent. G.; Bunt, R.; & Jenks, Ch. Sign, Symbol & Architecture. Chichester, England: John Willey & Sons, 1980.

Cosmides, L. & Tooby, J. Evolutionary Psychology: A Primer. Center for Evolutionary Psychology, University of California, Santa Barbara, 1997. URL: http://cogweb.ucla.edu/ep/EP-primer.html   (accessed <May 1, 2024)

Daelemans, B. Spiritus loci: A Theological Method for Contemporary Church Architecture. Leiden–Boston: Brill, 2015.

Eco, U. Function and Sign: Semiotics of Architecture, in M. Gottdiener & A.P. Lagopoulos (eds.): The City and the Sign: An Introduction to Urban Semiotics. New York: Columbia University Press, 1986.

Goh, J.O.S., Leshikar, E.D., Sutton, B.P.,Chow Tan, J.,3 Sim, S.K.Y., Hebrank, A., & Park, D.C. Culture differences in neural processing of faces and houses in the ventral visual cortex. SCAN, 2010, 5, 227-235

Hejduk, R., & Williamson, J. The Religious Imagination in Modern and Contemporary Architecture: A Reader: Taylor & Francis, 2011.

Herzog T.R.; Pierre Ouellette, P.; Rolens, J.R.; Angela M. Koenigs, A.M. Houses of Worship as Restorative Environments, Environment and Behavior, 2011, 42(4), 395-419.

Hildebrand, G. Origins of Architectural Pleasure. Berkeley, CA: University of California Press, 1999.

Hillier, B. & Hanson J. The Social Logic of Space. Cambridge, UK: Cambridge University Press, 1984.

Hollander, J.B. & Anderson, E.C. The impact of urban façade quality on affective feelings, Archnet-IJAR, 2020,14 (2), 219-232. https://doi.org/10.1108/ARCH-07-2019-0181

Jaeger, S. (Ed.). Magnificence and the Sublime in Medieval Aesthetics: Art, Architecture, Literature, Music New York: Palgrave Macmillan, 2010.

John Paul II, Letter of his Holiness Pope John Paull II to artists (1999) URL: https://w2.vatican.va/content/john-paul-ii/en/letters/1999/documents/hf_jp-ii_let_23041999_artists.html

Jones, L. The Hermeneutics of Sacred Architecture. Cambridge, Mass: Harvard University Press, 2000.

Kieckhefer, R. Theology in Stone. Church Architecture from Byzantium to Berkeley. New York: Oxford Univ. Press, 2004.

Lawson, B. The Language of Space. Oxford, UK: Architectural Press, 2001.

Levi, D. & Kocher, S. Perception of Sacredness at Heritage Religious Sites. Environment and Behavior 2012, 45(7), 912–930; DOI: 10.1177/0013916512445803.

Lukken, G., & Searle, M. Semiotics and Church Architecture. Kampen, The Netherlands: Kok Pharos  Publishing House, 1993.

Mann, A. T.  Sacred Architecture: Element Books, 1993.

Manzo, L.C. & Devine-Wright, P. Place Attachment. Advances in Theory, Methods and Applications. New York: Routledge, 2013.

Otto, R. The Idea of the Holy. New York: Oxford University Press, 1970.

Ouellette, P., Kaplan, R., & Kaplan, S. The monastery as a restorative environment. Journal of Environmental Psychology, 2005, 25, 175–188.

Psarra, S. Architecture and Narrative. The formation of space and cultural meaning. New York: Routledge, 2009.

Preziosi, D. The Semiotics of the Built Environment. Bloomington, Indiana: Indiana University Press, 1979.

Ratzinger, J. Quotes on Architecture by Pope Benedict XVI. Sacred Architecture Journal, 2019. URL: http://www.sacredarchitecture.org/features/quotes_on_architecture_by_pope_benedict_xvi (accessed May 1, 2024)

Ritchie, I. (ed.)  Neuroarchitecture: A Special issue of Architectural Design, AD  Nov-Dec 2020, 90 (6)

Schwarz, R. The Church Incarnate. The Sacre Function of Christian Architecture. Chicago: Henry Regnery Company, 1958.

Seasoltz, R.K. A Sense of the Sacred: Theological Foundations of Christian Architecture and Art. New York: Continuum, 2005.

Stegers, R. Sacred Buildings: A Design Manual. Basel, Switzerland: Birkhauser, 2008.

Suger, Abbot. Liber de Rebus in Administratione Sua Gestis, circa 1140s. URL: https://sourcebooks.fordham.edu/source/sugar.asp (accessed May 1, 2024)

Sussman, A. & Hollander J.B. Cognitive Architecture. Designing for How We Respond to the Built Environment. 2nd edition, New York, Routledge, 2021.

Thiessen, G.E. (Ed.). Theological Aesthetics, A Reader. Grand Rapids, MI: William B. Eerdmans Publishing Company, 2004.

Thomas, J. A. (1994). Theory, Meaning and Experience in Church Architecture (Ph.D. Thesis). University of Sheffield, School of Architectural Studies.

Vartanian, O., Navarrete, G., Chatterjee, A., Fich, L. B., Gonzalez-Mora, J. L., Leder, H., et al. “Architectural design and the brain: Effects of ceiling height and perceived enclosure on beauty judgments and approach-avoidance decisions.” Journal of Environmental Psychology, 2015,  41, 10-18.

Viladesau, R. Theological Aesthetics. God in Imagination, Beauty, and Art. New York: Oxford University Press, 1999.

von Balthasar, H.U. The Glory of the Lord: A Theological Aesthetics, trans. By E. Leiva-Merikakis Riches and edited by J. Fessio & J. Riches. San Francisco, CA: Ignatius Press, 7 vols, 1983-1989.

Williams Robinson, J. Institution and Home: Architecture as a Cultural Medium. Amsterdam, The Netherlands, 2006.Wuerl, D. & Aqulina, M. The Church. Unlocking the Secrets to the Places Catholics Call Home. New York: Image, 2013.

Recent Articles
Sacred Geometry: The Spiritual Meaning of Islamic Architectural Technologies

Read More

A Framework for Sacred Architecture

Read More

Bridging East and West. The Hagia Sophia shaping Dom Hans van der Laan’s Architectonic Space.

Read More