Abstract
Pictures with affective content have been extensively used in scientific studies of emotion and sexuality. However, only a few standardized picture sets have been developed that offer explicit images, with most lacking pornographic pictures depicting diverse sexual practices. This study aimed to fill this gap through developing a standardized affective set of diverse pornographic pictures (masturbation, oral sex, vaginal sex, anal sex, group sex, paraphilia) of same-sex and opposite-sex content, offering dimensional affective ratings of valence, arousal, and dominance, as well as co-elicited discrete emotions (disgust, moral and ethical acceptance). In total, 192 pornographic pictures acquired from online pornography platforms and 24 control IAPS images have been rated by 319 participants (Mage = 22.66, SDage = 4.66) with self-reported same- and opposite-sex sexual attraction. Stimuli were representative of the entire affective space, including positively and negatively perceived pictures. Participants showed differential affective perception of pornographic pictures according to gender and sexual attraction. Differences in affective ratings related to participants’ gender and sexual attraction, as well as stimuli content (depicted sexual practices and sexes). From the stimuli set, researchers can select explicit pornographic pictures based on the obtained affective ratings and technical parameters (i.e., pixel size, luminosity, color space, contrast, chromatic complexity, spatial frequency, entropy). The stimuli set may be considered a valid tool of diverse explicit pornographic pictures covering the affective space, in particular, for women and men with same- and opposite-sex sexual attraction. This new explicit pornographic picture set (EPPS) is available to the scientific community for non-commercial use.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
The elicitation of emotions by visual stimuli is considered an important and very useful tool in psychological, neuroscientific, and clinical research, whereby these stimuli must be carefully selected depending on the design and research question (Gerrards-Hesse et al., 1994; Mauss & Robinson, 2009; Scherer, 2005).
Since the late 1990s, a handful of pictorial stimuli have been made available to the scientific community, which have been rated on affective rating scales by participants under certain standardized conditions (e.g., International Affective Picture System (IAPS) by Lang et al., 1999). However, few of these standardized picture sets provided stimuli with highly sexually explicit depictions, although with the advent of the Internet, pornographic content with an infinite number of different sexual scenarios has spread rapidly (Döring, 2009). The Internet has become a distribution channel for various forms of pornography, which is now easily accessible and usually free of charge, increasing its consumption worldwide and prompting problematic behaviors, such as lower sexual and relationship satisfaction, compulsive sexual behaviors (e.g., addiction like pornography consumption), and increased diverse sexual risk behaviors (Ballester-Arnal et al., 2017, 2022; Baranowski et al., 2019; Bártová et al., 2021; Daneback et al., 2009; Giménez-García et al., 2021; Hald, 2006; Martyniuk et al., 2016). The utilization of visual sexual stimuli has the potential to advance our comprehension of psychophysiological mechanisms underlying human sexual behavior and related disorders. Such research can contribute to shedding light on the phenomenology and neurobiological foundations of these conditions (Kowalewska et al., 2018).
The increasing popularity of pornographic material, and growing exposure to it, also made experimental research in this area relevant. The perception of highly explicit content is well investigable with visual sexual stimuli. In clinical and therapeutic settings, sexual stimuli can be used as part of treatment, and in forensic clinical settings, sexual stimuli may be used to evoke sexual response to provide an objective assessment of atypical sexual interests, for example, in nonconsenting sexual activities (Katz et al., 2023). Thus, sexual stimuli are not only useful in studying the effects of pornography consumption or sexual interests, but also in various basic and clinical studies related to human sexuality – whether in the field of functional neuroimaging, psychophysiology, or subjective assessment of perceived sexual arousal and the sexual response cycle – and can themselves also be used as control stimuli to elicit highly arousing affect in studies unrelated to sexuality research.
Nevertheless, efforts to provide sexual stimuli for other researchers have been rather limited (Cui et al., 2021; Daoultzis & Kordoutis, 2022; Jacob et al., 2011; Lang et al., 1999; Wierzba et al., 2015). Standardized visual sexual stimuli are scarce, and the few stimuli that are available are often not very explicit and do not adequately represent sexual diversity. Many of these stimuli are increasingly outdated; many of the images were collected several decades ago and may therefore be rather unsuitable for experimental research today, partly due to habituation but mainly due to changes in the way sexual content is represented (Jacob et al., 2011). In addition, only a limited amount of non-heteronormative content is available, such as images of same-sex couples in sexual interactions (e.g., NAPS ERO by Wierzba et al., 2015). This does not help to reduce bias in experimental studies that focus predominantly on men and heteronormative representations of sexuality (van’t Hof & Cera, 2021; Georgiadis & Kringelbach, 2012; Poeppl et al., 2016; Stoléru et al., 2012; Ziogas et al., 2020).
The perception and processing of sexual stimuli is related to the picture content and the observer's sexual orientation and gender identity (Wierzba, et al., 2015). Apart from that, studies using visual sexual stimuli to examine sexuality in the context of gender differences and sexual orientation are also difficult to compare, as the pictures used were often not properly controlled for a priori in this sense (Rupp & Wallen, 2009). So, it remains uncertain whether the observed differences represent different ways of arousal processing or merely different levels of arousal associated with the stimuli (Safron et al., 2007). It is not only differences in picture processing due to gender and sexual orientation that play a role in the study of human sexuality. An individual's sexual preferences are also of importance. Findings suggest that one's interest and response to visual sexual stimuli are also dependent upon the activities and situations depicted (Rupp & Wallen, 2009; Stoléru et al., 2012; Wierzba et al., 2015). Thus, in order to dissociate the influence of gender from sexual orientation and sexual preferences it seems necessary to perform counter-balanced studies involving different types of experimental material that appeal to different groups of individuals at a comparable level. Also, individual sexual preferences of participants related to sexual activities and practices have not been considered in previously available stimuli sets.
The current study seeks to further fill important gaps in the literature by examining sexual interests from a broader perspective as sexual attraction, sexual behavior, and one’s sexual orientation identity are all measures of sexual orientation that identify distinct, albeit overlapping, populations (Sell, 2007). Laumann et al. (2000) showed that 8.6–10% of individuals reported some same-sex sexuality, 75–88% reported same-sex sexual desire, 41–52% reported some same-sex sexual behavior, but only 16–27% reported a lesbian or gay identity. Also, in a young Spanish sample, a wide variability in terms of sexual orientation has been reported, with a significant percentage of young people (14.6%) considering themselves homosexual and bisexual and an even higher percentage (35.1%) whose sexual attraction is not directed exclusively towards the other sex (Ballester-Arnal & Gil-Llario, 2016). People who self-identified as heterosexual often experience same-sex attraction, fantasies, desires, and behavioral intentions (Nebot-Garcia et al., 2022). Additionally, when adolescents were asked to define sexual orientation, they did not perceive sexual behavior and self-identification as necessarily relevant but rather the individual's sexual attraction (Friedman et al, 2004). Within this study, participants were not divided into categories according to their self-identified sexual orientation but according to their sexual attraction to best account for sexual interests and not sexual identity, which could be further influenced by social norms and stigma (Grubbs et al., 2019; Schmitt & Fuller, 2015; Walters & Spengler, 2016).
Overall, this research aimed to offer a new standardized set of visual stimuli for emotion and sexuality research, the Explicit Pornographic Picture Set (EPPS), to address the above-mentioned limitations and ensure both experimental and clinical future research in controllable settings. This collection of contemporary pornographic images was selected to represent a wide range of explicit content suitable for research on women and men with exclusive opposite- and same-sex sexual attraction including a hybrid approach of dimensional and discrete assessment of normative affective ratings of valence, arousal, and dominance, as well as disgust and ethical and moral acceptance. This hybrid approach derives from the two predominant conceptualizations present in the study of human emotion, the dimensional and the discrete emotion models related to the assessment of affective responses (Harmon-Jones et al., 2017). The dimensional perspective assumes that emotions can be described in combinations of fundamental dimensions, such as hedonic valence, arousal, and dominance (Lang et al., 1993). The discrete or categorical model states that emotion space is composed of a circumscribed collection of different emotions (Barrett et al., 2007). Among others, disgust and morality have both been named important in human sexuality, especially in the perception and emotional processing of visual sexual stimuli (Andrews et al., 2015; Stark et al. 2005). The explicit content shall reflect a broad variety of content accounting for different sexual practices typically displayed on online pornography platforms, which are also popular in offline sexual encounters such as masturbation, oral, vaginal, anal, group sex and paraphiliac scenes of submission, sexual violence, and fetishes (Hald & Štulhofer, 2016; Herbenick et al., 2022a, b; Richters et al., 2006). Additionally, physical picture properties of EPPS stimuli will be presented since previously available affective or sexual stimuli were often not fully specified and their technical parameters not reported. This is an important contribution to prior literature as such technical features are known to influence the processing of images and hence should be already considered in the process of stimuli selection – especially in assessments of eye-tracking, functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), and electroencephalography (EEG) (Knebel et al., 2008; Lakens et al., 2013).
For the aforementioned reasons, this investigation had the following objectives: (1) Standardization of the EPPS, including the description of the distribution of the affective ratings. (2) Exploring the influence of gender and sexual attraction on the subjective evaluation of different pornographic stimuli categories. Normative ratings corresponding to diverse content categories of opposite- and same-sex female and male pornography performers will be compared for each group of participants of women with exclusive opposite-sex attraction, women with same-sex attraction, men with exclusive opposite-sex attraction and men with same-sex attraction. We hypothesized to find significant differences in the affective ratings based on the content of different sexual practices, shown opposite- and same-sexes of the pornography performers, and the gender and exclusive opposite- versus same-sex sexual attraction of the observers. Differences in line with the observer's sexual attraction were expected. For instance, individuals with same-sex interests would likely rate same-sex pornographic content of their interest as more emotionally arousing, more pleasant, less disgusting, as well as with higher ratings for dominance, and moral and ethical acceptance (Rupp & Wallen, 2009; Stoléru et al., 2012; Wierzba et al., 2015). (3) Testing the internal reliability of the affective ratings. (4) Reporting the physical properties (width, height, luminance, contrast, complexity, entropy, and color composition) of EPPS pictures, allowing for a more accurate selection of physically matching stimuli.
Methods
Participants
A sample of 333 individuals participated in the study. For the purpose of the standardization process, the participants were divided into groups according to their gender (W-women, M-men) and exclusive opposite-sex attraction (OA) or same-sex attraction (SA). Whereby a minimum number of ten participants per group (M-OA, M-SA, W-OA, W-SA) as raters per stimulus was targeted. This sample size of raters per stimulus has been recognized as an appropriate size in other standardization processes (Cui et al., 2021; Daoultzis & Kordoutis, 2022; Diconne et al., 2022).
Participants self-reported their gender, and the following analyses included those who identified as either men or women. Sexual attraction was assessed using Kinsey's (1948) Spanish adapted question asking, "which of the following statements best describes to whom you are sexually attracted?". Participants then responded on a Likert-type scale ranging from 1 = I am only attracted to the other sex to 7 = I am only attracted to my own sex. There was also another option reserved for asexual people: I am not attracted to either sex. Individuals who described themselves as asexual related to their sexual orientation, transsexual, or non-binary related to their gender identity had to be excluded from the further analysis (n = 14) in order to compare M-OA, M-SA, W-OA, and W-SA. Individuals who described themselves as only attracted to the other sex according to Kinsey's (1948) question are followingly referred to as women or men with exclusive opposite-sex attraction (W-OA, M-OA), and those who were also attracted to their own sex are referred to as women and men with same-sex attraction (W-SA, M-SA). Thus, from the included participants, those who selected questionnaire option 1 = I am only attracted to the other sex according to Kinsey's (1948) question are followingly referred to as women or men with exclusive opposite-sex attraction. Those who have described themselves according to Kinsey's (1948) question as also being attracted to their own sex, respectively, are referred to as women or men with same-sex attraction. Eventually, ratings from a total of 319 participants (44 M-OA, 47 M-SA, 90 W-OA, 138 W-SA) older than 18 years (Mage = 22.66, SDage = 4.66) were considered for the standardization. Post hoc analyses revealed that men with same-sex attraction (M-SA; Mage = 26.04, SDage = 7.40) were significantly older than M-OA (Mage = 23.18, SDage = 3.68, p = 0.012), W-OA (Mage = 21.56, SDage = 4.06, p < 0.001), and W-SA (Mage = 22.06, SDage = 3.44, p < 0.001). Most of the participants (88.25%) were students or graduates from different faculties and departments of various universities in Spain. The other 11.75% reported post-compulsory secondary education. No significant differences were found regarding levels of education between W-OA, M-OA, W-SA, and M-SA participants (Χ2(3) = 4.408, p = 0.221).
Several recruitment channels were used, including mass mailings organized by non-profit organizations, as well as social media and personal invitations of students at the faculties of the Universities of Jaén or Jaume I, Spain. The procedures used in this study adhere to the tenets of the Declaration of Helsinki. Approval was obtained from the ethics committee of the Universitat Jaume I (Castelló de la Plana, Spain).
Stimulus material
Explicit pornographic pictures (N = 1123) were gathered through an extensive online web search and a wide spectrum of pornographic scenarios was collected and eventually categorized by six experts in the field of sexuality according to the sexual practices and the sexes of the pornography performers depicted using a forced-decision task to avoid blended categories of pornographic images. Pictures were only included in the standardization process, if there was total agreement among experts related to the offered categories of masturbation (M), oral sex (O), vaginal sex (V), anal sex (A), group sex (G), and paraphilia (P).
After the categorization by experts in the field, for this first standardization, four sets of each 48 sexually explicit pornographic images from the first time sought explicit pornographic pictures (N = 1123) and the 24 IAPSFootnote 1 (Lang et al., 1999) control stimuli were used. Since the IAPS constitutes a well-established and world-wide used resource of standardized pictorial stimuli for emotion research, images of mutilation (unpleasant), sports/adventure (pleasant) and neutral people (neutral) were presented to be able to employ and compare control stimuli of affective value without sexual content (Lang et al., 1999; Lang & Bradley, 2007). Pictures from the IAPS were selected based on the normative values for affective valence and arousal in Spanish samples (Moltó et al., 1999, 2013; Vila et al., 2001). IAPS normative affective ratings for each category were as follows: unpleasant (valence: M = 1.88; SD = 0.34; arousal: M = 7.43; SD = 0.25), pleasant (valence: M = 6.78; SD = 0.50; arousal: M = 7.33; SD = 0.48), and neutral pictures (valence: M = 5.19; SD = 0.51; arousal: M = 3.49; SD = 0.32).
The pornographic images included here differ in the types of sexual content shown, providing a diversity of highly explicit scenes, as well as diversity related to depicted sexes of the pornography performers, offering same-sex, opposite-sex, solo-sex, and group-sex scenarios. Like Hald (2006) categorized any kind of material aiming at creating or enhancing sexual feelings or thoughts in the recipient and, at the same time, containing explicit exposure and/or descriptions of the genitals or clear and explicit sexual acts as pornographic, pictures of M, O, V and A were labeled as explicit pornographic pictures. The categories of M, O and A provide same-sex and opposite-sex imagery. Additionally, this set offers an extra category of pictures of G scenarios as this type of content is also considered to be a very popular type of pornography (Hald & Štulhofer, 2016). Furthermore, scenarios of dominance/submission, sexual violence (sadomasochism, violent sex, aggression, bondage), and fetishes (including latex) were included and categorized under the extra category of paraphilia pornography (P). In a few cases, the categories of M and P only showed single individuals.
All sexually explicit pictures were resized to 1600×1200 or 1200×1600 pixels size and were granted access to the project by the pornography producers and distributors ErikaLust film productions or AmazingContent or were acquired from amateur (flickr) pornography platforms. Permission to use these images for research purposes has been granted by the aforementioned pornography producers and distributors. This approach was chosen to limit the possibility of including nonconsensual pornography, which is a significant ethical issue when working with freely available online sexual stimuli (Katz et al., 2023). Examples of the explicit pornographic pictures of the M, O, V, A, G, P categories are displayed in Fig. 1.
Procedure
Due to the sanitary health crisis inflicted by COVID-19, the assessment procedure took place via online meetings using Google Meet and Qualtrics XM. The participants worked on their private devices (PC, laptop, or tablet). Sessions lasted approximately 90 min. Each experimental session was conducted either in groups of 2–10 participants or in individual sessions, if it was requested by the participant.
Before the participants could start the study, they had to complete a short introduction and practice phase via Google Meet given by two experimental instructors in order to make sure that the instructions regarding the affective ratings were understood. Three practice pictures were viewed prior to the experimental ratings in order to provide participants with a range of the types of content that will be presented, as well as to anchor the affective rating scales. During the whole procedure, participants were able to ask the two instructors via Google Meet for private assistance when in doubt. Written consent was obtained from each participant and the possibility to quit the experiment at any point without stating reasons was ensured. The full text of the Spanish instructions and its English translation are enclosed in the supplementary materials.
Each participant was presented with 72 pictures equaling one set of images, whereby to date in total, four independent sets of explicit pornographic pictures were standardized. The stimuli consisted of equal-sized (eight images each) categories of sexual practices: masturbation (M), oral sex (O), vaginal sex (V), anal sex (A), group sex (G), paraphilia (P). As control, images of mutilation, sports and neutral people of the IAPS were included (eight per category) into the standardization process. Stimuli were presented in randomized order using the Qualtrics randomization tool.
The images were assessed one at a time. A single picture was displayed for 6 s, and then on the following pages adapted versions of the nine-point Self-Assessment Manikin (Bradley & Lang, 1994) rating scales for the dimensional affective ratings of valence, arousal and dominance were presented in a randomized order to avoid halo effects. Followingly nine-point Likert rating scales for the discrete emotional categories of disgust as well as moral and ethical acceptance were presented also in a randomized order. The disgust scale ranged from 1 – this picture is nothing at all, to 9 – this picture is extremely disgusting. The moral and ethical acceptance scale ranged from 1 – absolutely immoral, to 9 – totally acceptable. Figure 2 shows a schematic representation of this sequence with an exemplar of a neutral IAPS image and the adapted versions of the SAM for valence, arousal, and dominance ratings, as well as the ratings scales used to assess disgust and ethical and moral acceptance. Participants were asked to give an immediate, spontaneous reaction to the seen pictures. For 6 s, each rating scale was available before skipping to the next. After 2 s, additionally, participants also had the option to click on a next button in order to see the next rating scale. As soon as the participants finished the ratings of one picture, a new screen with the subsequent randomized picture was displayed.
After the affective ratings task participants were presented with questionnaires, as well as sexual behavior questions, which will be presented elsewhere. On average the participants needed 56.1 min (SD = 8.87) to finish the online part of the study.
Statistical analysis
Data were analyzed using the statistics program JMP 17.0 and RStudio Desktop (RStudio Inc., Boston, MA, USA). The significance threshold was set to α = 0.05, thus the cut-off for statistical significance was p < 0.05.
Results
Affective ratings
Ratings from 67.7 participants on average were collected for each picture (n = 77 for Set 1, n = 82 for Set 2, n = 94 for Set 3, n = 66 for Set 4). Mean and standard deviation for the ratings in valence, arousal, dominance, disgust, and moral and ethical acceptance were calculated for each individual picture, for the overall sample and split for women and men with exclusive opposite-sex attraction vs. same-sex attraction separately (W-OA, W-SA, M-OA, M-SA). This data can be found in the supplementary material.
Furthermore, to analyze relationships between the affective ratings of the explicit pornographic stimuli, we first employed bivariate Pearson correlations between valence and arousal. A significant positive correlation between valence and arousal ratings (r(190) = .66, p < .0001) was found. Valence also correlated positively with dominance (r(190) = .71, p < .0001) and ratings of moral and ethical acceptance (r(190) = .77, p < .0001), but negatively with disgust (r(190) = – .62, p < .0001). Similarly, arousal was positively related with dominance (r(190) = .37, p < .0001) and moral and ethical acceptance (r(190) = .23, p < .0001), but negatively with disgust (r(190) = – .30, p < .0001). Further significant negative correlations were found between ratings of disgust and moral and ethical acceptance (r(190) = – .54, p < .0001). These analyses were performed separately for each participant group. As observed in Table 1, the results were similar in all groups, except for the relationship between arousal and dominance ratings, which only was statistically significant in the M-OA and W-SA groups. Also, the correlations between arousal and moral and ethical acceptance did not reach the significance level in W-SA but all the other groups.
In addition, the relationships between the affective ratings of the IAPS control pictures were analyzed with bivariate Pearson correlations. A significant negative correlation was found (r(190) = – .51, p = .01) between valence and arousal. Nevertheless, the IAPS ratings of valence correlated, like the EPPS stimuli, positively with dominance (r(190) = .86, p < .0001) and moral and ethical acceptance (r(190) = .98, p < .0001), but negatively with disgust (r(190) = – .98, p < .0001). For the IAPS pictures, negative relationships between arousal and dominance (r(190) = – .86, p < .0001) and moral and ethical acceptance (r(190) = – .66, p < .0001) were found. Moreover, IAPS ratings of arousal correlated positively with disgust (r(190) = .65, p < .0001). Again, similar to EPPS images, significant negative correlations were found for the IAPS control stimuli between disgust and moral and ethical acceptance (r(190) = – .99, p < .0001).
Gender, sexual attraction, and stimuli content
Furthermore, the affective ratings to the M, O, V, A, G, P sexual practice categories of opposite- and same-sex content have been compared in the W-OA, W-SA, M-OA, M-SA participant groups. Figure 3 shows the affective space formed by averaged valence and arousal ratings to the different sexual practices and IAPS control pictures, for W-OA, W-SA, M-OA, M-SA separately. The scatterplots of this study show a particular distribution of the pornographic content as most of the pornographic images score high in valence and arousal. Including the IAPS control images, a curvilinear pattern of distribution emerged for all participant groups. In the scatterplots is also included the distribution of the different sexual practices (M, O, V, A, G, P) by opposite- and same-sex (male, female) content, showing, for example, that the high arousal and high valence quadrant presented for W-OA, W-SA and M-OA a relatively higher number of M, O and V, G pictures, but for M-SA this quadrant also included a relatively bigger number of A same sex male images. Further, the space of lower valence and arousal scores presented a relatively high number of P content for all participants.
Three-way ANOVAs were performed with these mean ratings to evaluate the effects of participant groups defined by gender and sexual attraction (W-OA, W-SA, M-OA, M-SA), and stimuli content of shown sexual practices (M, O, V, A, G, P) and sexes (opposite-sex, same-sex male, same-sex female) on the affective ratings of valence, arousal, dominance, disgust, and moral and ethical acceptance. The few M images (N = 3) that only showed single individuals were added to either the content category of SS-Females when a female single individual, or to the content category of SS-Males when a male single individual, was depicted. Regarding depicted sexes, the images of group sex (G) and paraphilia (P) were categorized as extra categories. Figure 4 shows these mean values of the averaged affective ratings to the EPPS pictures of the different shown sexual practices and shown sexes for the participant groups of W-OA, W-SA, M-OA, M-SA. For valence, main effect of participant groups (F(3, 720) = 21.51, p < 0.001, η2 = 0.03), shown sexual practices (F(5, 718) = 109.76, p < 0.001, η2 = 0.11), and shown sexes (F(2, 721) = 74.29, p < 0.001, η2 = 0.08) were found. There was no statistically significant three-way interaction for valence, but significant two-way interactions between participant groups and shown sexual practices (F(15, 708) = 5.89, p < 0.001, η2 = 0.01), and between participant groups and shown sexes (F(6, 717) = 53.18, p < 0.001, η2 = 0.17). Also, for arousal, main effects of participant groups (F(3, 720) = 52.05, p < 0.001, η2 = 0.10), shown sexual practices (F(5, 718) = 36.16, p < 0.001, η2 = 0.06), and shown sexes (F(2, 721) = 74.59, p < 0.001, η2 = 0.10) were found. There was also no statistically significant three-way interaction for arousal, but significant two-way interactions between participant groups and shown sexual practices (F(15, 708) = 3.49, p < 0.001, η2 = 0.01), and between participant groups and shown sexes (F(6, 717) = 48.46, p < 0.001, η2 = 0.19). For dominance, main effects of participant groups (F(3, 720) = 27.39, p < 0.001, η2 = 0.08), shown sexual practices (F(5, 718) = 18.53, p < 0.001, η2 = 0.02), and shown sexes (F(2, 721) = 16.08, p < 0.001, η2 = 0.03) were found. There was also no statistically significant three-way interaction for dominance, but a significant two-way interaction between participant groups and shown sexes (F(6, 717) = 5.04, p < 0.001, η2 = 0.03). Analysis of disgust ratings showed main effects of participant groups (F(3, 720) = 21.41, p < 0.001, η2 = 0.05), shown sexual practices (F(5, 718) = 59.90, p < 0.001, η2 = 0.07), and shown sexes (F(2, 721) = 23.30, p < 0.001, η2 = 0.03). Three-way interaction for disgust did not reach the significance level, but the two-way interactions between participant groups and shown sexual practices (F(15, 708) = 3.38, p < 0.001, η2 = 0.01), between participant groups and shown sexes (F(6, 717) = 24.90, p < 0.001, η2 = 0.11), and between shown sexual practices and sexes (F(3, 720) = 2.64, p = 0.049, η2 = 0.01) were significant. For ratings of moral and ethical acceptance, main effects of participant groups (F(3, 720) = 42.17, p < 0.001, η2 = 0.08), shown sexual practices (F(5, 718) = 129.52, p < 0.001, η2 = 0.12), and shown sexes (F(2, 721) = 6.18, p < 0.001, η2 = 0.01) were found. There was also no statistically significant three-way interaction for moral and ethical acceptance, but a significant two-way interaction between participant groups and shown sexes (F(6, 717) = 24.90, p < 0.001, η2 = 0.02).
Additionally, to offer a more in-depth analysis of each image category related to the participants gender and sexual attraction, the mean scores for the affective ratings of each image were compared within each sexual practice split by shown sexes between W-OA, W-SA, M-OA, M-SA participant group using one-way analyses of variance and pairwise multiple-comparisons tests, with Tukey HSD post hoc tests and Cohen’s d effect sizes (see Table 2). Regarding affective ratings of valence, W-OA, W-SA, M-OA, M-SA participants only showed no significant differences related to the P category (p = 0.109). Further, no significant differences between W-OA, W-SA, M-OA, M-SA participants were observed in the dominance ratings related to same-sex female M (p = 0.103), same-sex female O (p = 0.728), V (p = 0.05) and P (p = 0.205) images. Regarding disgust ratings the W-OA, W-SA, M-OA, M-SA participants only showed no significant differences related to the opposite-sex M (p = 0.079), opposite-sex A (p = 0.281) and P (p = 0.124) images. Also, for ratings of moral and ethical acceptance no significant differences were found between W-OA, W-SA, M-OA, M-SA participants in opposite-sex M (p = 0.21) and P (p = 0.06) image content.
Reliability of EPPS affective ratings
Regarding the internal consistency of these evaluations, split-half reliability scores (Ruiz-Padial et al., 2021; Wierzba et al., 2015) were calculated. To this end, participants were numbered according to their order of participation, and each sample that evaluated one of the four sets of pictures was split into two groups (i.e., odd vs. even participant numbers). The average ratings for valence, arousal, dominance, disgust, and moral and ethical acceptance were then calculated separately for each picture and within each participant group. To calculate split-half reliability scores, Pearson correlations among these average ratings were analyzed for the two groups of participants of each sample. All correlations were significant (p < 0.001), and Spearman–Brown-corrected reliability scores were high for the four sets of pictures (valence: r = 0.984, r = 0.979, r = 0.987, r = 0.960; arousal: r = 0.953, r = 0.945, r = 0.958, r = 0.904; dominance: r = 0.941, r = 0.944, r = 0.936, r = 0.873; disgust: r = 0.984, r = 0.990, r = 0.991, r = 0.983; moral and ethical acceptance: r = 0.991, r = 0.990, r = 0.994, r = 0.972 for Sets 1, 2, 3, and 4, respectively).
Physical picture parameters of EPPS stimuli
Physical picture parameters of luminance, contrast, mean channel values in CIE 1976 L*a*b color space, spatial frequency in nine different bands, and JPG size are reported in the supplementary material. The physical picture parameters were calculated using MATLAB (www.mathworks.com). Luminance was defined as the average pixel value of the grayscale version of the images, while contrast consists of the standard deviation of the pixel values of those (Bex & Makous, 2002). Further, the JPEG compression rate of images, and the entropy, which refers to the level of intensity of individual pixels in grayscale images, are considered indicators of image complexity (Donderi, 2006). The JPEG sizes of the color images were determined with a compression quality setting of 80 (on a scale of 1 to 100), indicating the bigger the more complex an image is. In addition, each picture was converted to the CIE L*a*b* color space. The color composition in CIE 1976 L* a* b* space expresses color in three values considering the level of brightness and the values of the four basic colors of human vision (red, green, blue, yellow), and approximates characteristics of the human visual system. The L* dimension corresponds to luminance (range, 0–100), and a* and b* correspond to two chromatic channels ranging from red (positive values) to green (negative values), and from blue (negative values) to yellow (positive values) (Tkalcic & Tasic, 2003).
To analyze whether the average affective ratings of valence and arousal given by the participants for the EPPS images were related to physical picture properties, as seen in other studies (e.g., Bradley & Lang 2000; Carretié et al., 2019), bivariate Pearson correlations were performed. Neither luminance nor contrast or entropy (p > .05) were significantly associated with valence and arousal. Regarding L* and a* color space, a significant correlation was only found between arousal and the a* dimension (r(190) = .15, p = .03). For the b* dimension, significant correlations were found with valence (r(190) = .21, p = .004) and arousal (r(190) = .18, p = .01). JPEG size correlated for the EPPS images negatively with valence (r(190) = – .23, p = .002) and arousal (r(190) = – .19, p = .01), meaning that less complex images received higher affective valence and arousal ratings.
Discussion
This paper presents EPPS, a stimuli set of explicit pornographic pictures suitable for experimental research in a wide range of disciplines. The collection is useful for studies with men and women who differ in terms of their sexual attraction to the male or female sex. In this regard, the EPPS differs from all other existing sets of standardized sexual stimuli, which have previously relied on strict categorization into heterosexual and homosexual orientations (Cui et al., 2021; Daoultzis & Kordoutis, 2022; Jacob et al., 2011; Wierzba et al., 2015). This approach was taken because a person's sexual orientation need not be a one-to-one reflection of his or her exclusive sexual preferences for a particular sex at a particular time. Indeed, individuals who describe themselves as heterosexual may nevertheless feel strong sexual attraction towards a person of the same-sex (Katz-Wise & Todd, 2022; VanderLaan et al., 2022). Models trying to define sexual orientation have changed over time. Today, models that attempt to create static categories for sexual orientation are often avoided. Instead, there is increased reliance on more fluid models that allow for changes in sexual orientation over time and that speak to situational flexibility in an individual's sexual responsiveness (Ballester-Arnal & Gil-Llario, 2016). Thus, it has been recognized that changes in sexual desire can be experienced in both the short and long term (Klein, 1978; Klein et al., 1985). Sexual attraction can change as a result of a variety of situational, interpersonal, and social factors (Katz-Wise & Todd, 2022). It is especially important to be aware of this aspect when interested in how initial sexual responses occur and sexual arousal manifests, especially from a physiological point of view. Sexual orientation also reflects the emotional, romantic, or – but not necessarily – sexual attraction that a person feels toward another person (Klein, 1978; Klein et al., 1985). Sexual orientation can thus be understood as a more diverse concept of the self in relation to the unfolding of interpersonal (sexual) relationships, whereas sexual attraction might be closer to the initial sexual responses of sexual arousal. As previously reported, there seems to exist a wide variability in terms of self-reported sexual orientation and sexual attraction (Ballester-Arnal & Gil-Llario, 2016; Laumann et al., 2000), with higher percentages reporting same-sex sexual desires and same-sex sexual attraction, but fewer individuals identify themselves as non-heterosexual. So, asking for a person's sexual attraction might be able to better capture these sexual desires – which likely play out also in physiological responses when confronted with sexually interesting stimuli – than asking about self-reported sexual orientation – which does not seem to be perceived as sexual attraction that a person feels toward another one. With the EPPS, researchers will have the opportunity to be aware of such potential differences in advance, to have data that address sexual attraction, and to try to minimize romantic and emotional influences of sexual orientation.
The EPPS offers explicit sexual images along with a hybrid approach of dimensional and discrete assessment of normative ratings of valence, arousal, and dominance, as well as disgust and ethical and moral acceptance. Similar to other standardization studies of sexual images there was content that was rated as very positive in terms of these affective ratings by the participants. However, there were also categories of sexual practices which were rated as rather unpleasant by all groups of participants, such as the category of paraphilia stimuli. Like other studies, where applicable, a distinction is made between opposite- and same-sex scenes in the categorization of sexual stimuli (Stoléru et al., 2012; Wierzba et al., 2015). Thereby, further were sexual images identified which were rated as unpleasant by one group of participants but pleasant by another due to the opposite- and same-sex content shown. For example, those depicting male couples were rated as least pleasant, arousing, able to maintain control and ethical and morally acceptable but most disgusting by men with opposite sex attraction but perceived in the opposite way by men with same sex attraction. Men with opposite sex attraction seem to show strong preferences for opposite-sex content. Women showed less pronounced patterns in this regard. Nevertheless, the affective ratings of the women to the opposite- and same-sex content were also often in accordance with their self-reported sexual attraction. The EPPS does not only contain images that received a positive rating of high pleasantness, but also aversive or negatively perceived ones. This goes in line with previous research, showing that although sexual stimuli are typically processed as pleasant, they can also provoke levels of negative emotional response (Bradley et al., 2001a; Lalumière et al., 2022; Larsen & McGraw, 2011; Suschinsky & Lalumière, 2011; Staley & Prause, 2013). Thus, researchers interested in disentangling emotional and sexual responses have better access to sexual stimuli that are representative of the entire affective space.
Regarding the affective space of the EPPS images compared to the IAPS control pictures, different relationships were found between arousal and the affective ratings of valence, dominance, and disgust. As previously reported with respect to other picture sets (Bradley & Lang, 2000; Carretié et al., 2019), a significant correlation between EPPS valence and arousal ratings was found. However, we have not seen an increase in arousal as valence decreases like Carretié et al. (2019), but a positive correlation between arousal and valence ratings, which may relate to the sexual nature of the stimuli (Wierzba et al., 2015). For the sexually explicit images of the EPPS, emotional arousal increases as ratings of valence become increasingly more pleasant and disgust decreases, while feelings of control are maintained. The opposite outcome becomes apparent when analyzing the IAPS stimuli. For the assessed IAPS pictures, emotional arousal increases as ratings of valence become increasingly more unpleasant and more disgusting, and feelings of less control over the affective state. These findings to the IAPS control pictures are in line with previous research (Carretié et al., 2019; Lang & Bradley, 2007; Moltó et al., 2013). The observed differences between the assessed affective ratings (i.e., valence, arousal, dominance, disgust, moral and ethical acceptance) of the EPPS and the control IAPS images (i.e., pleasant sports scenes, neutral scenes of humans, unpleasant scenes of mutilation) further illustrate the different affective character of the sexually explicit images of the EPPS compared with the IAPS control pictures. Such observed differences between the affective space of the EPPS and the IAPS stimuli relate, on one hand, to the very sexually explicit contents of the EPPS, and on the other hand, to the inclusion of very unpleasant and highly arousing content of mutilation for the IAPS images, two differing extremes in the affective space. Pictures of erotica are known to highly activate the appetitive system, whereas threatening stimuli such as the ones selected in our study highly activate the defense system (Lang & Bradley, 2007). Additionally, some differences based on the participants’ gender and sexual attraction in the relationships between the affective ratings were observed, which need further exploration. It is not clear why, for example, no significant correlations were found between arousal and dominance to EPPS images in M-SA and W-OA, while there were medium-level positive correlations in M-OA and W-SA. Indeed, prior studies on affective ratings of arousal, valence, and dominance revealed sex differences (Bradley et al., 2001b). However, these findings were not contextualized in relation to the participants' sexual orientation. Therefore, our results may relate to gender-related traits of social roles within women and men of different sexual interests (Lippa, 2002).
The analyses presented here suggest that gender and sexual attraction play a role in affective ratings towards pornographic content. Consistent with previous research, the responses of women who were exclusively attracted to the opposite-sex were less specific than those of the other participant groups (Chivers et al., 2010; Ziogas et al., 2020). Interaction effects were found between gender, sexual attraction, and content of the images. In general, the shown content seems to be related to all affective ratings obtained (i.e., valence, arousal, dominance, and disgust and moral and ethical acceptance) towards pornographic stimuli. However, small effect sizes must be noted in this regard. Consequently, and consistent with previous research (Rupp & Wallen, 2009; Wierzba et al., 2015), the image content and the viewer's gender and sexual attraction play a role in the affective perception of pornographic material. There were preferences for certain types of images, indicating gender- and sexual attraction-specific preferences.
The sexual preferences of the observer play an important role in the affective processing of sexual stimuli (Waismann et al., 2003; Wierzba et al., 2015), which has also been observed in this study. In this regard, experimental and clinical studies using diverse sexual visual material can help to better understand human sexuality and its diversity (Stolerú et al., 2012). For example, the role of sexual media in young adulthood has already been extensively studied (e.g., Ballester-Arnal et al., 2017; Træen et al., 2006; Morgan, 2011; Ward, 2003; Wright et al., 2022). Because young adulthood is a time of sexual exploration and development (Arnett, 2014; Lefkowitz & Gillen, 2006), it is not surprising that sexually explicit media may also be an important source of information for young adults (Ballester-Arnal et al., 2017; Træen et al., 2006; Ward, 2003; Wright et al., 2022). The frequency and types of pornography use also appear to be associated with higher sexual preferences for certain types of sexual practices (Morgan, 2011). The use of pornography may play an important role in a variety of aspects of sexual development processes. In this context, researchers have discussed possible negative effects of viewing sexually explicit media, such as lower sexual and relationship satisfaction, problematic pornography consumption and increased sexual risk behaviors (Ballester-Arnal et al., 2017, 2021; Li et al., 2022; Morgan, 2011). In addition, an increase in aggressive content in pornographic videos has also been reported, with such aggressive and violent pornography repeatedly being associated with problematic outcomes such as sexually aggressive attitudes and behaviors (Bártová et al., 2021; Bridges et al., 2010, 2016; Carrotte et al., 2020; Vandenbosch & van Oosten, 2017). These data particularly point to the clinical importance of the availability of standardized materials to implement methodologically comparable experimental research in this field. Thus, material such as the EPPS can also give insights for evaluating and treating sexual disorders and relevant societal problems (e.g., sexual arousal dysfunctions, compulsive sexual behaviors such as problematic pornography consumption or paraphilic disorders). In particular, research measuring both central or peripheral correlates (e.g., fMRI, MEG, EEG, facial EMG, autonomic activity) to enhance the understanding of neurobiological underpinnings of human sexuality and sexual disorders, may benefit from a stimuli set with a range of different sexually explicit pictures. To this extent, studies in the field have so far lacked inclusion of diverse populations since predominantly heterosexual male participants have been studied (van’t Hof & Cera, 2021).
To summarize, EPPS images vary in terms of affective ratings and provide nuanced pleasant/unpleasant, arousing, and varying degrees of disgusting, and ethically and morally acceptable sexual scenes to deepen our understanding of human sexuality by facilitating research in this area, also from a clinical point of view. In addition, physical image parameters that have been shown to be important in modulating the affective impact of visual stimuli were calculated and analyzed (Carretié et al., 2019; Knebel et al., 2008; Lakens et al., 2013). Our analyses further highlighted significant associations indexing physical–affective relationships. Arousal and valence have been shown to correlate with the color space and complexity of the EPPS images. The given affective ratings in combination with the provided physical image parameters for each image should be able to guide the selection of stimuli according to the requirements of different experimental designs.
Nevertheless, there are some limitations to this study. First, the EPPS ratings were collected from a population of rather young adults with a high educational background, recruited mainly at universities. Given that there is some evidence for effects of age and sociocultural factors on valence and arousal ratings and emotion processing (Gruhn & Scheibe, 2008), a replication study in an older sample and from other sociocultural backgrounds should be a future goal. Even though Spanish samples seem to be essentially similar in respect to the assessments of emotional pictures (Moltó et al., 1999; Moltó et al., 2013; Soares et al., 2015; Vila et al., 2001), cultural differences in the evaluation of the affective scenes are possible and should be further assessed. Secondly, the EPPS contains mainly pleasant and highly arousing images. Consequently, this new picture set is asymmetric in this sense, lacking rather neutral images. According to the experimental literature, neutral stimuli tend to be assessed from low to medium emotional arousal, and score in the mid-range of affective valence ratings (Ruiz-Padial et al., 2021). As sexual stimuli rarely fall into this category, a sample of IAPS control pictures (Lang et al., 1999) were accordingly included in the standardization process of the EPPS. Nevertheless, filling a research gap, the EPPS offers a range of pleasant/unpleasant and arousing, as well as more disgusting and less ethically and morally acceptable, sexually explicit images. Apart from subjective ratings indicating differences related to viewers’ gender and sexual attraction, such differences in EPPS ratings should be further validated by measuring central and peripheral psychophysiological correlates (e.g., fMRI, EEG, electrodermal and cardiovascular activity, facial EMG, startle reflex, eye-tracking, or penile and vaginal photoplethysmography). Further monitoring of hormone levels would also be recommended, as hormonal fluctuations due to menstrual cycle or contraceptive use may influence the perception of sexual stimuli (Renfro et al., 2015; Shirazi et al., 2018; Suschinsky et al., 2014; Wallen & Rupp, 2010). It is unclear how far hormonal fluctuations in males may influence such processes (Hardy et al., 2005; Wu et al., 2022). Therefore, future studies should investigate any of the above physiological biomarkers of individuals in relation to their affective perception towards different sexual stimuli, including a more diverse sampling in terms of gender identities and a more nuanced assessment of sexual interests.
Despite the above limitations and methodological improvements that could be implemented over time, the EPPS adds to the current literature as it constitutes a reliable pictorial set comprising a wide range of pornographic images normed on both dimensional and discrete affective ratings. In addition to providing important physical picture parameters, it opens new avenues for basic and clinical experimental designs in emotion and sexuality research.
Conclusions
The EPPS dataset offers standardized explicit pornographic pictures of diverse sexual practices (masturbation, oral sex, vaginal sex, anal sex, group sex, paraphilia) of opposite- and same-sex pornography. Normative ratings of valence, arousal, and dominance, as well as disgust and moral and ethical acceptance ratings, were available of participants with sexual attraction to either exclusively the opposite-sex or also the same-sex. Additionally, several physical characteristics were computed to provide relevant picture properties (width, height, luminance, contrast, complexity, entropy, and color composition), allowing for an easier and more accurate selection of physically matching stimuli. The EPPS dataset is freely available for the research community on OSF (https://osf.io/s5dhb/?view_only=9f54594ec51641a484da36ef0bf1c4e6), upon request to the corresponding author, in order to enhance a certain level of comparability across studies using visual sexual stimuli, and to facilitate affective picture selection for experimental and clinical research.
Data availability
Data to instructions, as well as the affective ratings and physical properties of each image, are available as online supplementary material on OSF (https://osf.io/s5dhb/?view_only=9f54594ec51641a484da36ef0bf1c4e6). The images of the EPPS can be acquired in color or gray format for noncommercial research purposes by contacting the corresponding author through email (mpastor@uji.es). This approach had to be chosen in order to fulfill the collaboration agreements with the pornography producers and distributors.
Code availability
Not applicable.
Notes
The included IAPS stimuli are the following: 3400 (mutilated arm), 3130 (mutilated upper body), 3120 (mutilated upper body), 3110 (burned upper body), 3060 (mutilated face), 3030 (mutilated face), 3010 (mutilated face), 3071 (mutilated neck), 8341(aerobatics plane), 8193 (man skiing), 8178 (ski diver on a waterfall), 8191(man doing ice climbing), 8186 (man doing sky snowboarding), 8185 (group of skydivers), 8179 (boy bungee jumping), 5621 (group of skydivers), 2745.1 (female shopping), 2575 (mechanic working), 2396 (couple coming downstairs), 2104 (female looking into camera), 2102 (man reading the newspaper), 2036 (female shopping), 2026 (cashier), 2513 (elder female looking into camera).
References
Andrews, A. R., Crone, T., Cholka, C. B., Cooper, T. V., & Bridges, A. J. (2015). Correlational and experimental analyses of the relation between disgust and sexual arousal. Motivation and Emotion, 39(5), 766–779. https://doi.org/10.1007/s11031-015-9485-y
Arnett, J. J. (2014). Emerging adulthood: The winding road from the late teens through the twenties. Oxford University Press.
Ballester-Arnal, R., Castro Calvo, J., Gil-Llario, M. D., & Gil-Julia, B. (2017). Cybersex addiction: A study on Spanish college students. Journal of Sex & Marital Therapy, 43(6), 567–585. https://doi.org/10.1080/0092623X.2016.1208700
Ballester-Arnal, R., Castro-Calvo, J., García-Barba, M., Ruiz-Palomino, E., & Gil-Llario, M. D. (2021). Problematic and non-problematic engagement in online sexual activities across the lifespan. Computers in Human Behavior, 120(3), 106774. https://doi.org/10.1016/j.chb.2021.106774
Ballester-Arnal, R., García-Barba, M., Castro-Calvo, J., Giménez-García, C., & Gil-Llario, M. D. (2022). Pornography consumption in people of different age groups: An analysis based on gender, contents, and consequences. Sexuality Research and Social Policy, 1–14. https://doi.org/10.1007/s13178-022-00720-z
Ballester-Arnal, R., & Gil-Llario, M. D. (2016). Orientación del deseo sexual: Crisis y decadencia de los modelos categoriales. Sexología positiva, 59–66.
Baranowski, A. M., Vogl, R., & Stark, R. (2019). Prevalence and determinants of problematic online pornography use in a sample of German women. The Journal of Sexual Medicine, 16(8), 1274–1282. https://doi.org/10.1016/j.jsxm.2019.05.010
Barrett, L. F., Mesquita, B., Ochsner, K. N., & Gross, J. J. (2007). The experience of emotion. Annual Review of Psychology., 58, 373–403. https://doi.org/10.1146/annurev.psych.58.110405.085709
Bártová, K., Androvičová, R., Krejčová, L., Weiss, P., & Klapilová, K. (2021). The prevalence of paraphilic interests in the Czech population: Preference, arousal, the use of pornography, fantasy, and behavior. The Journal of Sex Research, 58(1), 86–96. https://doi.org/10.1080/00224499.2019.1707468
Bex, P. J., & Makous, W. (2002). Spatial frequency, phase, and the contrast of natural images. Journal of the Optical Society of America, 19(6), 1096–1106. https://doi.org/10.1364/josaa.19.001096
Bradley, M. M., Codispoti, M., Cuthbert, B. N., & Lang, P. J. (2001a). Emotion and motivation I: Defensive and appetitive reactions in picture processing. Emotion, 1(3), 276–298. ://doi.org/https://doi.org/10.1037/1528-3542.1.3.276
Bradley, M. M., Codispoti, M., Sabatinelli, D., & Lang, P. J. (2001). Emotion and motivation II: Sex differences in picture processing. Emotion, 1(3), 300.
Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25(1), 49–59. https://doi.org/10.1016/0005-7916(94)90063-9
Bradley, M. M., & Lang, P. J. (2000). Measuring emotion: Behavior, feeling, and physiology. In R. D. Lane & L. Nadel (Eds.), Cognitive neuroscience of emotion (pp. 242–276). Oxford University Press.
Bridges, A. J., Wosnitzer, R., Scharrer, E., Sun, C., & Liberman, R. (2010). Aggression and sexual behavior in best-selling pornography videos: A content analysis update. Violence Against Women, 16(10), 1065–1085. https://doi.org/10.1177/1077801210382866
Bridges, A. J., Sun, C. F., Ezzell, M. B., & Johnson, J. (2016). Sexual scripts and the sexual behavior of men and women who use pornography. Sexualization, Media, & Society, 2(4), 2374623816668275. https://doi.org/10.1177/2374623816668275
Carretié, L., Tapia, M., López-Martín, S., & Albert, J. (2019). EmoMadrid: An emotional pictures database for affect research. Motivation and Emotion, 43(1), 929–939. https://doi.org/10.1007/s11031-019-09780-y
Carrotte, E. R., Davis, A. C., & Lim, M. S. (2020). Sexual behaviors and violence in pornography: Systematic review and narrative synthesis of video content analyses. Journal of Medical Internet Research, 22(5), e16702. https://doi.org/10.2196/16702
Chivers, M. L., Seto, M. C., Lalumière, M. L., Laan, E., & Grimbos, T. (2010). Agreement of self-reported and genital measures of sexual arousal in men and women: A meta-analysis. Archives of Sexual Behavior, 39(1), 5–56. https://doi.org/10.1007/s10508-009-9556-9
Cui, Q., Wang, Z., Zhang, Z., & Li, Y. (2021). The East Asian erotic picture dataset and gender differences in response to opposite-sex erotic stimuli in Chinese college students. Frontiers in Psychology, 12, 648271. https://doi.org/10.3389/fpsyg.2021.648271
Daneback, K., Træen, B., & Månsson, S. A. (2009). Use of pornography in a random sample of Norwegian heterosexual couples. Archives of Sexual Behavior, 38(5), 746–753. https://doi.org/10.1007/s10508-008-9314-4
Daoultzis, K. C., & Kordoutis, P. (2022). A pilot study testing a new visual stimuli database for probing men’s gender role conflict: GRASP (Gender Role Affective Stimuli Pool). Journal of Homosexuality, 1–24. https://doi.org/10.1080/00918369.2022.2104147
Diconne, K., Kountouriotis, G. K., Paltoglou, A. E., Parker, A., & Hostler, T. J. (2022). Presenting KAPODI–The Searchable Database of Emotional Stimuli Sets. Emotion Review, 14(1), 84–95. https://doi.org/10.1177/17540739211072803
Donderi, D. C. (2006). Visual complexity: A review. Psychological Bulletin, 132(1), 73–97. https://doi.org/10.1037/0033-2909.132.1.73
Döring, N. M. (2009). The Internet’s impact on sexuality: A critical review of 15 years of research. Computers in Human Behavior, 25(5), 1089–1101. https://doi.org/10.1016/j.chb.2009.04.003
Friedman, M. S., Silvestre, A. J., Gold, M. A., Markovic, N., Savin-Williams, R. C., Huggins, J., & Sell, R. L. (2004). Adolescents define sexual orientation and suggest ways to measure it. Journal of Adolescence, 27(3), 303–317. https://doi.org/10.1016/j.adolescence.2004.03.006
Georgiadis, J. R., & Kringelbach, M. L. (2012). The human sexual response cycle: Brain imaging evidence linking sex to other pleasures. Progress in Neurobiology., 98(1), 49–81. https://doi.org/10.1016/j.pneurobio.2012.05.004
Gerrards-Hesse, A., Spies, K., & Hesse, F. W. (1994). Experimental inductions of emotional states and their effectiveness: A review. British Journal of Psychology, 85(1), 55–78. https://doi.org/10.1111/j.2044-8295.1994.tb02508.x
Giménez-García, C., Nebot-Garcia, J. E., Ruiz-Palomino, E., García-Barba, M., & Ballester-Arnal, R. (2021). Spanish women and pornography based on different sexual orientation: An analysis of consumption, arousal, and discomfort by sexual orientation and age. Sexuality Research and Social Policy. https://doi.org/10.1007/s13178-021-00617-3
Grubbs, J. B., Perry, S. L., Wilt, J. A., & Reid, R. C. (2019). Pornography problems due to moral incongruence: An integrative model with a systematic review and meta-analysis. Archives of Sexual Behavior, 48(2), 397–415. https://doi.org/10.1007/s10508-018-1248-x
Gruhn, D., & Scheibe, S. (2008). Age-related differences in valence and arousal ratings of pictures from the International Affective Picture System (IAPS): Do ratings become more extreme with age? Behavior Research Methods, 40(2), 512–521. https://doi.org/10.3758/BRM.40.2.512
Hald, G. M. (2006). Gender differences in pornography consumption among young heterosexual Danish adults. Archives of Sexual Behavior, 35(5), 577–585. https://doi.org/10.1007/s10508-006-9064-0
Hald, G. M., & Štulhofer, A. (2016). What types of pornography do people use and do they cluster? Assessing types and categories of pornography consumption in a large-scale online sample. Journal of Sex Research, 53(7), 849–859. https://doi.org/10.1080/00224499.2015.1065953
Hardy, M. P., Gao, H. B., Dong, Q., Ge, R., Wang, Q., Chai, W. R., Feng, X., & Sottas, C. (2005). Stress hormone and male reproductive function. Cell and Tissue Research, 322(1), 147–153. https://doi.org/10.1007/s00441-005-0006-2
Harmon-Jones, E., Harmon-Jones, C., & Summerell, E. (2017). On the importance of both dimensional and discrete models of emotion. Behavioral Sciences, 7(4), 66. https://doi.org/10.3390/bs7040066
Herbenick, D., Fu, T. C., & Patterson, C. (2022a). Sexual repertoire, duration of partnered sex, sexual pleasure, and orgasm: findings from a US nationally representative survey of adults. Journal of Sex & Marital Therapy, 1–22. https://doi.org/10.1080/0092623X.2022.2126417
Herbenick, D., Rosenberg, M., Golzarri-Arroyo, L., Fortenberry, J. D., & Fu, T. C. (2022b). Changes in penile-vaginal intercourse frequency and sexual repertoire from 2009 to 2018: Findings from the national survey of sexual health and behavior. Archives of Sexual Behavior, 51(3), 1419–1433. https://doi.org/10.1007/s10508-021-02125-2
Jacob, G. A., Arntz, A., Domes, G., Reiss, N., & Siep, N. (2011). Positive erotic picture stimuli for emotion research in heterosexual females. Psychiatry Research, 190(2–3), 348–351. https://doi.org/10.1016/j.psychres.2011.05.044
Katz, M. A., Penniston, T. L., Barry, C., Micanovic, N., Seto, M. C., & Chivers, M. L. (2023). Use of sexual stimuli in research and clinical settings: expert opinion and recommendations. Sexual Medicine, 11(2), qfad012. https://doi.org/10.1093/sexmed/qfad012
Katz-Wise, S. L., & Todd, K. P. (2022). The current state of sexual fluidity research. Current Opinion in Psychology, 48, 101497. https://doi.org/10.1016/j.copsyc.2022.101497
Kim, H., Lu, X., Costa, M., Kandemir, B., Adams, R. B., Jr., Li, J., Wang, J. Z., & Newman, M. G. (2018). Development and validation of Image Stimuli for Emotion Elicitation (ISEE): A novel affective pictorial system with test–retest repeatability. Psychiatry research, 261, 414–420. https://doi.org/10.1016/j.psychres.2017.12.068
Kinsey, A. C., Pomery, W. B., & Martin, C. E. (1948). Kinsey scale. Personality and Social Psychology Bulletin. https://doi.org/10.1037/t17515-000
Klein, F. (1978). The bisexual option. Arbor House.
Klein, F., Sepekoff, B., & Wolf, T. J. (1985). Sexual orientation: A multi-variable dynamic process. Journal of Homosexuality, 11, 35–49.
Knebel, J. F., Toepel, U., Hudry, J., Le Coutre, J., & Murray, M. M. (2008). Generating controlled image sets in cognitive neuroscience research. Brain Topography, 20(4), 284–289. https://doi.org/10.1007/s10548-008-0046-5
Kowalewska, E., Grubbs, J. B., Potenza, M. N., Gola, M., Draps, M., & Kraus, S. W. (2018). Neurocognitive mechanisms in compulsive sexual behavior disorder. Current Sexual Health Reports, 10, 255–264. https://doi.org/10.1007/s11930-018-0176-z
Lakens, D., Fockenberg, D. A., Lemmens, K. P., Ham, J., & Midden, C. J. (2013). Brightness differences influence the evaluation of affective pictures. Cognition & Emotion, 27(7), 1225–1246. https://doi.org/10.1080/02699931.2013.781501
Lalumière, M. L., Sawatsky, M. L., Dawson, S. J., & Suschinsky, K. D. (2022). The empirical status of the preparation hypothesis: Explicating women’s genital responses to sexual stimuli in the laboratory. Archives of Sexual Behavior, 51(2), 709–728. https://doi.org/10.1007/s10508-019-01599-5
Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1999). International affective picture system (IAPS): Technical manual and affective ratings. University of Florida.
Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30(3), 261–273. https://doi.org/10.1111/j.1469-8986.1993.tb03352.x
Lang, P., & Bradley, M. M. (2007). The International Affective Picture System (IAPS) in the study of emotion and attention. Handbook of Emotion Elicitation and Assessment, 29, 70–73.
Larsen, J. T., & McGraw, A. P. (2011). Further evidence for mixed emotions. Journal of Personality and Social Psychology, 100(6), 1095. https://doi.org/10.1037/a0021846
Laumann, E. O., Gagnon, J. H., Michael, R. T., & Michaels, S. (2000). The social organization of sexuality: Sexual practices in the United States. University of Chicago Press.
Lefkowitz, E. S., & Gillen, M. M. (2006). "Sex Is Just a Normal Part of Life": Sexuality in Emerging Adulthood. In Emerging adults in America: Coming of age in the 21st century. (pp. 235–255). American Psychological Association.
Li, M., Liu, Y., & Zheng, L. (2022). Sexually explicit internet media consumption and sexual risk behaviors among Chinese male sexual minorities: The moderating role of perceived realism. Health Communication, 1–7. https://doi.org/10.1080/10410236.2022.2053272
Lippa, R. A. (2002). Gender-related traits of heterosexual and homosexual men and women. Archives of Sexual Behavior, 31, 83–98. https://doi.org/10.1023/A:1014035302843
Mauss, I. B., & Robinson, M. D. (2009). Measures of emotion: A review. Cognition and emotion, 23(2), 209–237. https://doi.org/10.1080/02699930802204677
Martyniuk, U., Briken, P., Sehner, S., Richter-Appelt, H., & Dekker, A. (2016). Pornography use and sexual behavior among Polish and German university students. Journal of Sex & Marital Therapy, 42(6), 494–514. https://doi.org/10.1080/0092623X.2015.1072119
Moltó, J., Montañés, S., Poy, R., Segarra, P., Pastor, M. C., & Tormo, M. P. (1999). Un nuevo método para el estudio experimental de las emociones: El International Affective Picture System (IAPS). Adaptación española. Baremos nacionales. Iberpsicología: Revista Electrónica de la Federación española de Asociaciones de Psicología, 5(1), 8.
Moltó, J., Segarra, P., López, R., Esteller, À., Fonfría, A., Pastor, M. C., & Poy, R. (2013). Adaptación eapañola del" International Affective Picture System"(IAPS). Tercera parte. Anales de Psicología/Annals of Psychology, 29(3), 965–984. https://doi.org/10.6018/analesps.29.3.153591
Morgan, E. M. (2011). Associations between young adults’ use of sexually explicit materials and their sexual preferences, behaviors, and satisfaction. Journal of sex research, 48(6), 520–530. https://doi.org/10.1080/00224499.2010.543960
Nebot-Garcia, J. E., Giménez-García, C., García-Barba, M., Gil-Llario, M. D., & Ballester-Arnal, R. (2022). What Does Heterosexuality Mean? Same-Sex Attraction, Behaviors, and Discomfort Among Self-identified Heterosexual Young Adults from Spain. Archives of Sexual Behavior, 51(7), 3431–3442.
Poeppl, T. B., Langguth, B., Rupprecht, R., Laird, A. R., & Eickhoff, S. B. (2016). A neural circuit encoding sexual preference in humans. Neuroscience and Biobehavioral Reviews, 68, 530–536. https://doi.org/10.1016/j.neubiorev.2016.06.025
Renfro, K. J., Rupp, H., & Wallen, K. (2015). Duration of oral contraceptive use predicts women’s initial and subsequent subjective responses to sexual stimuli. Hormones and Behavior, 75, 33–40. https://doi.org/10.1016/j.yhbeh.2015.07.013
Richters, J., De Visser, R., Rissel, C., & Smith, A. (2006). Sexual practices at last heterosexual encounter and occurrence of orgasm in a national survey. Journal of Sex Research, 43(3), 217–226. https://doi.org/10.1080/00224490609552320
Ruiz-Padial, E., Pastor, M. C., Mercado, F., Mata-Martín, J. L., & García-León, A. (2021). MATTER in emotion research: Spanish standardization of an affective image set. Behavior research methods, 53, 1973–1985. https://doi.org/10.3758/s13428-021-01567-9
Rupp, H. A., & Wallen, K. (2009). Sex-specific content preferences for visual sexual stimuli. Archives of Sexual Behavior, 38(3), 417–426. https://doi.org/10.1007/s10508-008-9402-5
Safron, A., Barch, B., Bailey, J. M., Gitelman, D. R., Parrish, T. B., & Reber, P. J. (2007). Neural correlates of sexual arousal in homosexual and heterosexual men. Behavioral neuroscience, 121(2), 237–248. https://doi.org/10.1037/0735-7044.121.2.237
Scherer, K. R. (2005). What are emotions? And how can they be measured? Social Science Information, 44(4), 695–729. https://doi.org/10.1177/053901840505821
Schmitt, D. P., & Fuller, R. C. (2015). On the varieties of sexual experience: Cross-cultural links between religiosity and human mating strategies. Psychology of Religion and Spirituality, 7(4), 314–326. https://doi.org/10.1037/rel0000036
Sell, R. L. (2007). Defining and measuring sexual orientation for research. In The health of sexual minorities (pp. 355–374). Springer, Boston, MA.
Shirazi, T. N., Bossio, J. A., Puts, D. A., & Chivers, M. L. (2018). Menstrual cycle phase predicts women’s hormonal responses to sexual stimuli. Hormones and Behavior, 103, 45–53. https://doi.org/10.1016/j.yhbeh.2018.05.023
Staley, C., & Prause, N. (2013). Erotica viewing effects on intimate relationships and self/partner evaluations. Archives of Sexual Behavior, 42(4), 615–624. https://doi.org/10.1007/s10508-012-0034-4
Stark, R., Walter, B., Schienle, A., & Vaitl, D. (2005). Psychophysiological correlates of disgust and disgust sensitivity. Journal of Psychophysiology, 19(1), 50–60. https://doi.org/10.1027/0269-8803.19.1.50
Soares, A. P., Pinheiro, A. P., Costa, A., Frade, C. S., Comesaña, M., & Pureza, R. (2015). Adaptation of the International Affective Picture System (IAPS) for European Portuguese. Behavior Research Methods, 47(4), 1159–1177. https://doi.org/10.3758/s13428-014-0535-2
Stoléru, S., Fonteille, V., Cornélis, C., Joyal, C., & Moulier, V. (2012). Functional neuroimaging studies of sexual arousal and orgasm in healthy men and women: A review and meta-analysis. Neuroscience and Biobehavioral Reviews, 36(6), 1481–1509. https://doi.org/10.1016/j.neubiorev.2012.03.006
Suschinsky, K. D., Bossio, J. A., & Chivers, M. L. (2014). Women’s genital sexual arousal to oral versus penetrative heterosexual sex varies with menstrual cycle phase at first exposure. Hormones and Behavior, 65(3), 319–327. https://doi.org/10.1016/j.yhbeh.2014.01.006
Suschinsky, K. D., & Lalumière, M. L. (2011). Prepared for anything? An investigation of female genital arousal in response to rape cues. Psychological Science, 22(2), 159–165. https://doi.org/10.1177/0956797610394660
Tkalcic, M., & Tasic, J. F. (2003). Colour spaces: Perceptual, historical and applicational background. In Proceedings of EUROCON 2003: Computer as a Tool (Vol. 1, pp. 304–308). Piscataway, NJ: IEEE.
Træen, B., Nilsen, T. S. R., & Stigum, H. (2006). Use of pornography in traditional media and on the Internet in Norway. Journal of Sex Research, 43(3), 245–254. https://doi.org/10.1080/00224490609552323
Vandenbosch, L., & van Oosten, J. M. (2017). The relationship between online pornography and the sexual objectification of women: The attenuating role of porn literacy education. Journal of Communication, 67(6), 1015–1036. https://doi.org/10.1111/jcom.12341
VanderLaan, D. P., Skorska, M. N., Peragine, D. E., Coome, L. A., Moskowitz, D. A., Swift-Gallant, A., & Monks, D. A. (2022). Carving the biodevelopment of same-sex sexual orientation at its joints. Archives of Sexual Behavior. https://doi.org/10.1007/s10508-022-02360-1
van’t Hof, S. R., & Cera, N. (2021). Specific factors and methodological decisions influencing brain responses to sexual stimuli in women. Neuroscience & Biobehavioral Reviews, 131, 164–178. https://doi.org/10.1016/j.neubiorev.2021.09.013
Vila, J., Sánchez, M. B., Ramírez, I., Fernández, M. C., Cobos, M. P., Rodríguez, S., Muñoz, M. Á., Tormo, M. P., Herrero, M., Segarra, P., Pastor, M. C., Montañes, S., Poy, R., Moltó, J. (2001). El Sistema Internacional de Imágenes Afectivas (IAPS): Adaptación Española. Segunda parte. Revista de psicología general y aplicada: Revista de la Federación Española de Asociaciones de Psicología, 54(4), 635–657.
Waismann, R., Fenwick, P. B. C., Wilson, G. D., Hewett, T. D., & Lumsden, J. (2003). EEG responses to visual erotic stimuli in men with normal and paraphilic interests. Archives of Sexual Behavior, 32(2), 135–144. https://doi.org/10.1023/A:1022448308791
Wallen, K., & Rupp, H. A. (2010). Women’s interest in visual sexual stimuli varies with menstrual cycle phase at first exposure and predicts later interest. Hormones and Behavior, 57(2), 263–268. https://doi.org/10.1016/j.yhbeh.2009.12.005
Walters, N. T., & Spengler, P. M. (2016). Clinical errors and therapist discomfort with client disclosure of troublesome pornography use: Implications for clinical practice and error reduction. Psychotherapy, 53(3), 354–359. https://doi.org/10.1037/pst0000079
Ward, L. M. (2003). Understanding the role of entertainment media in the sexual socialization of American youth: A review of empirical research. Developmental Review, 23(3), 347–388. https://doi.org/10.1016/S0273-2297(03)00013-3
Wierzba, M., Riegel, M., Pucz, A., Leśniewska, Z., Dragan, W. Ł, Gola, M., Jednoróg, K., & Marchewka, A. (2015). Erotic subset for the Nencki Affective Picture System (NAPS ERO): Cross-sexual comparison study. Frontiers in Psychology, 6, 1–13. https://doi.org/10.3389/fpsyg.2015.01336
Wright, P. J., Tokunaga, R. S., Herbenick, D., & Paul, B. (2022). Pornography vs. sexual science: The role of pornography use and dependency in US teenagers’ sexual illiteracy. Communication Monographs, 89(3), 332–353. https://doi.org/10.1080/03637751.2021.1987486
Wu, Y., Ou, J., Wang, X., Zilioli, S., Tobler, P. N., & Li, Y. (2022). Exogeneous testosterone increases sexual impulsivity in heterosexual men. Psychoneuroendocrinology, 145, 105914. https://doi.org/10.1016/j.psyneuen.2022.105914
Ziogas, A., Habermeyer, E., Santtila, P., Poeppl, T. B., & Mokros, A. (2020). Neuroelectric correlates of human sexuality: A review and meta-analysis. Archives of Sexual Behavior, 52, 497–596. https://doi.org/10.1007/s10508-019-01547-3
Acknowledgements
The authors would like to thank the experts (Mª Dolores Gil-Llario, Marta García-Barba, Naiara Martínez-Gómez, Vicente J. Morell-Mengual, Jesús Castro, Juan Enrique Nebot-Garcia) that participated in the pre-selection process of the images, as well as all participants for taking part in the study.
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. Funding for open access charge: Universitat Jaume I.
Universitat Jaume I,Open Access Charge
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Consent to participate
Informed consent was obtained from all individual participants included in the study.
Consent for publication
All participants were informed and consented to the publication of anonymized data.
Conflict of interest
The authors have no competing interests to declare.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Prantner, S., Giménez-García, C., Espino-Payá, A. et al. The standardization of a new Explicit Pornographic Picture Set (EPPS). Behav Res (2024). https://doi.org/10.3758/s13428-024-02418-z
Accepted:
Published:
DOI: https://doi.org/10.3758/s13428-024-02418-z