Introduction

In the early years of the Internet Age, the potential of using the Internet as a distribution channel excited business managers who believed this tool would boost sales and increase organizational performance (Hansen 1995; Westland and Au 1997). These believers suspected an online presence could offer advantages to their customers, while providing a shopping experience similar to the traditional bricks-and-mortar store (Jarvenpaa and Todd 1996). The advantages included providing around the clock access for customers, reducing geographic boundaries to provide access to new markets, and enabling immediate communication with customers.

The prediction of an explosion of online shopping became a marriage between information technology experts and marketing professionals. Most would believe the information technology researchers were studying the Internet technology and its advantages, while the marketers were focused on the consumer’s use of the technology. As technology advanced, more marketing activities emerged to market goods and services via the Internet. Today, Internet marketing is defined as “the use of the Internet as a virtual storefront where products are sold directly to the customer” (Kiang et al. 2000, p. 383), or another view includes “the strategic process of creating, distributing, promoting, and pricing products for targeted customers in the virtual environment of the Internet” (Pride et al. 2007). This research attempts to categorize the various Internet marketing activities in a broad context including strategies such as customer relationship management (Hwang 2009), electronic marketplaces (Novak and Schwabe 2009), online auctions (Loebbecke et al. 2010), and electronic branding (Otim and Grover 2010) in tandem with unique IS issues including web site evaluation (Chiou et al. 2010), piracy (Smith and Telang 2009), security (Ransbotham and Mitra 2009), and technology architecture (Du et al. 2008).

With concepts as varied as this in one research domain, a periodic review is necessary to discover and explore new technologies such as mobile banking (Sripalawat et al. 2011), virtual worlds (Sutanto et al. 2011), and social media (de Valck et al. 2009) as they emerge on the Internet marketing landscape. The following sections of the paper will examine the current literature to determine what is known about the concept of Internet marketing. First, a description of the methodology for the analysis of the Internet marketing research is presented. This is followed by the results including an analysis of a smaller sample of the Internet marketing research in the top Marketing journals. Finally, the research is summarized with a discussion of the limitations of this project and suggestions for future research.

Methodology

The approach to this analysis of the Internet marketing research is to first identify trends in the Information System (IS) literature. Specifically, we wished to capture the trends pertaining to (1) the number and distribution of Internet marketing articles published in the leading journals, (2) methodologies employed in Internet marketing research, and (3) the research topics being published in this area of research. During the analysis of the literature, we attempted to identify gaps and needs in the research and therefore discuss a research agenda which allows for the progression of research (Webster and Watson 2002). In short, we hope to paint a representative landscape of the current Internet marketing literature base in IS in order to influence the direction of future research efforts in this important area of study.

In order to examine the current state of research on Internet marketing, the authors conducted a literature review and analysis in three phases: Phase 1 accumulated a representative pool of articles; Phase 2 classified the articles by research method; and, Phase 3 classified the research by research topic. Each of the three phases is discussed in the following paragraphs.

Phase 1: accumulation of article pool

We used the Thomson Reuters Web of Science (WoS) citation database and Google Scholar to search for research articles with a focus on Internet marketing. The search parameters were constrained based on (a) a list of top ranked journals, (b) a specific time range, and (c) key search terms.

First, the researchers chose to use the top 30 journals from Peffers and Tang’s (2003) IS journals ranking (see Table 1). Peffers and Tang’s (2003) ranking of ‘pure’ IS journals was adopted for this study because it was based on the responses of IS researchers who were asked to rank journals by their “relative value to the researcher and the audience as an outlet for IS research.” In Peffers and Tang’s (2003) original ranking scheme two journals, ‘Communications of the Association of Information Systems’ and ‘Information and Management,’ tied for fifth place. Peffers and Tang resolved this issue by ranking both journals in the fifth position skipping the rank of the sixth position. As noted in Table 1, 7 of the top 30 journals were not listed in the WoS database. Consequently, all 30 journals were searched using Google Scholar and only 23 journals were searched using the WoS database. The search parameters were further constrained to a specific timeframe.

Table 1 Top 30 ranked IS journals and the number of articles

Electronic commerce and Internet marketing did not exist prior to the widespread adoption and dissemination of the public Internet and the Worldwide Web (WWW). Therefore, the search parameters were further constrained based on the historical timeframe in which technologies capable of facilitating the development of e-commerce were first introduced. The graphical user interface based browser known as Netscape Navigator was launched as a free download for public use in 1994. Many experts identify the launch of Netscape Navigator as the historical event leading to the global public’s widespread adoption and use of the Internet and the World Wide Web (WWW) (Friedman 2006). Therefore, the search parameters for both WoS and Google Scholar were constrained to time period of 1994 through August of 2011.

The final constraint was based on the key search term “Internet Marketing.” In both WoS and Google Scholar the search engine scanned for the term ‘Internet Marketing’ and close variations of this term found in the title, abstract, and keywords of articles published in the top 30 IS journals between January of 1994 and August of 2011 when the search was executed. There was considerable overlap in the pool of articles returned from the two search engines (WoS and Google Scholar). Once duplicate entries and non-research articles (book reviews, editorials, commentary, etc.) were removed 453 articles remained in the composite data pool. The researchers then reviewed each article and identified 42 articles that were unrelated to the topic of Internet marketing. These 42 articles represented false positives returned from the WoS and Google Scholar search engines and were subsequently removed leaving 411 articles in the final composite article data pool for analysis.

Phase 2: classification by research strategy

Once the researchers identified the articles for the final data pool, each article was examined and categorized according to its research strategy. Due to the subjective nature of research strategy classification, content analysis methods were used for the categorization process. Figure 1 illustrates steps in the content analysis process adapted from Neuendorf (2002) and successfully employed by several similar research studies (Corley et al. 2011; Cumbie et al. 2005; Jourdan et al. 2008). First, the research categories were adopted from Scandura and Williams (2000) (see Table 2), who extended the research strategies initially described by McGrath (1982). Specifically, nine categories of research strategies were selected including: Formal theory/literature reviews, sample survey, laboratory experiment, experimental simulation, field study (primary data), field study (secondary data), field experiment, judgment task, and computer simulation.

Fig. 1
figure 1

Overview of literature analysis

Table 2 Research strategies

Second, to guard against the threats to reliability (Neuendorf 2002), we performed a pilot test on articles meeting the search parameters from other top journals. That is, the articles used in the pilot test (a) were not part of the data set generated in Phase 1, and (b) the data generated from the pilot test were not included in the final data analysis for this study. Researchers independently categorized the articles in the pilot test based on the best fit among the nine research strategies. After all articles in the pilot test were categorized, the researchers compared their analyses. In instances where the independent categorizations did not match the researchers re-evaluated the article collaboratively by reviewing the research strategy definitions, discussing the disagreement thoroughly, and collaboratively assigning the article to a single category. This process allowed the researchers to develop a collaborative interpretation of the research strategy definitions. Simply stated, this pilot test served as a training session for accurately categorizing the articles for this study with respect to research strategy.

Each research strategy is defined by a specific design approach and each is also associated with certain tradeoffs that researchers must make when designing a study. These tradeoffs are inherent flaws that limit the conclusions that can be drawn from a particular research strategy. These tradeoffs refer to three aspects of a study that can vary depending on the research strategy employed. These variable aspects include: generalizability from the sample to the target population (external validity); precision in measurement and control of behavioural variables (internal and construct validity); and the issue of realism of context (Scandura and Williams 2000).

Cook and Campbell (1976) stated that a study has generalizability when the study has external validity across times, settings, and individuals. Formal theory/literature reviews and sample surveys have a high degree of generalizability by establishing the relationship between two constructs and illustrating that this relationship has external validity. A research strategy that has low external validity but high internal validity is the laboratory experiment. In the laboratory experiment, where the degree of measurement precision is high, cause and effect relationships may be determined, but these relationships may not be generalizable for other times, settings, and populations. While the formal theory/literature reviews and sample surveys have a high degree of generalizability and the laboratory experiment has a high degree of precision of measurement, these strategies have low degree of contextual realism. The only two strategies that maximize degree of contextual realism are field studies that use either primary or secondary data because the data is collected in an organizational setting (Scandura and Williams 2000).

The other four strategies maximize neither generalizability, nor degree of precision in measurement, nor degree of contextual realism. This point illustrates the futility of using only one strategy when conducting Internet marketing research. Because no single strategy can maximize all types of validity, it is best for researchers to use a variety of research strategies. Table 2 contains an overview of the nine strategies and their ranking on the three strategy tradeoffs (Scandura and Williams 2000).

Two coders independently reviewed and classified each article according to research strategy. Only a few articles were reviewed at one sitting to minimize coder fatigue and thus protect intercoder reliability (Neuendorf 2002). Upon completion of the independent classification, a tabulation of agreements and disagreements were computed, intercoder crude agreement (percent of agreement) was 91.8 % percent, and intercoder reliability using Cohen’s Kappa (Cohen 1960) was calculated (k = 0.847). These two calculations were well within the acceptable ranges for intercoder crude agreement and intercoder reliability (Neuendorf 2002). The reliability measures were calculated prior to discussing disagreements as mandated by Weber (1990). If the original reviewers did not agree on how a particular article was coded, an additional reviewer arbitrated the discussion of how the disputed article was to be coded. This process resolved the disputes in all cases.

Phase 3: categorization by internet marketing research topic

Typically the process of categorizing research articles by a specific research topic involves an iterative cycle of brainstorming and discussion sessions among the researchers. This iterative process helps to identify common themes within the data pool of articles. Through the collaborative discussions during this process researchers can synthesize a hierarchical structure within the literature of overarching research topics and more granular level subtopics. The final outcome is a better understanding of the current state of a particular stream of research. This iterative process was modified for this specific study on the topic of Internet marketing.

During the initial stages of the current project the researchers began investigating tentative outlets for publishing a literature review on the topic of Internet marketing. A special call for papers (CFP) on the topic of Internet marketing from the journal ‘Electronic Marketing’ was identified as a potential target journal by one of the authors. Further investigation revealed that the editors had outlined six specific research topic categories for the special CFP including: Business Models of Online Marketing, The Future of Search Strategies, The Internet Advertising Landscape, Commercial Exploitation of Web 2.0 in Consumer Marketing and in an Organizational Context, Evaluation of Online Performance, and Other Topics. Each of these six research topics was accompanied by a general definition and a few examples. The researchers adopted these six research topics to categorize the articles in the data pool.

A second pilot study was performed mirroring the first pilot test as a means of training for categorizing articles by research topic. Researchers independently categorized the articles in the pilot test based on the best fit among the six research topics. After all articles in the pilot test were categorized, the researchers compared their analyses. In instances where the independent categorizations did not match, the researchers re-evaluated the article collaboratively by reviewing the research category definitions, discussing the disagreement thoroughly, and collaboratively assigning the article to a single category. This process allowed the researchers to develop a collaborative interpretation of the research topic definitions (see Table 3).

Table 3 Internet marketing topics

Once we established the category definitions, we independently placed each article in one Internet marketing category. As before, we categorized only a few articles at a time to minimize coder fatigue and thus protect intercoder reliability (Neuendorf 2002). Upon completion of the classification process, we tabulated agreements and disagreements, intercoder crude agreement (percent of agreement) was 86.2 %, and intercoder reliability using Cohen’s Kappa (Cohen 1960) for each category was calculated (k = .08137). Again, the latter two calculations were well within the acceptable ranges (Neuendorf 2002). We again calculated the reliability measures prior to discussing disagreements as mandated by Weber (1990). If the original reviewers did not agree on how a particular article was coded, a third reviewer arbitrated the discussion of how the disputed article was to be coded. This process also resolved the disputes in all cases.

Results

In order to identify gaps and needs in the research (Webster and Watson 2002), we hope to paint a representative landscape of the current Internet marketing literature base in order to influence the direction of future research efforts in this important area of study. In order to examine the current state of this research, the authors conducted a literature review and analysis in three phases. Phase 1 accumulated a representative pool of Internet marketing articles, and the articles were then analyzed with respect to year of publication and journal. Phase 2 contains a short discussion of the research strategies set forth by Scandura and Williams (2000) and the results of the classification of the articles by those research strategies. Phase 3 involved the creation and use of six Internet marketing research topics, a short discussion of each topic, and the results of the classification of each article within the research topics. These results are discussed in the following paragraphs.

Results of phase 1

Using the described search criteria within the selected journals, we collected a total of 411 articles (For the complete list of articles in our sample, see Appendix A.) In phase 1, we further analyzed the articles’ year of publication and journal. Figure 2 shows the number of articles per year in our sample. Please note that 2011 only represents articles acquired using WoS and Google Scholar search engines which were available at the time (August 2011) the search was conducted. There is a general increasing trend over the 18 year period, but no articles were found to be published in 1994 & 1996. The year 2010 shows the most activity with 52 articles (12.7 %). With Internet marketing issues becoming ever more important to researchers and practitioners, this comes as no surprise. Understanding 2011 was only a partial year in our sample, we were not concerned by the difference in quantity of publications over time.

Fig. 2
figure 2

Number of Internet Marketing Articles Published Per Year

In order to identify the research strategies used by Internet marketing research articles in the top 30 Information Systems (IS) journals in our sample, Table 4 was created to show the number of Internet marketing articles in each journal broken down by research strategy. This table illustrates the high level of Internet marketing publications that use the Formal Theory/Literature Review, Sample Survey, Field Study – Primary, and Field Study – Secondary research strategies. This indicates a body of research that is still in the exploratory stages. This table also illustrates the proclivity of some journals to accept certain research strategies over others. For example, the journals Decision Support Systems, International Journal of Electronic Commerce, and Journal of Management Information Systems had articles in this data set using seven of the nine research strategies. With this information, researchers that favour certain research strategies can target their research papers to journals that favour these strategies.

Table 4 Top 30 IS journals vs. research strategy
Fig. 3
figure 3

Number of Internet Marketing Articles Published in Each Research Strategy Category

Results of phase 2

The results of the categorization of the 411 articles according to the nine research strategies described by Scandura and Williams (2000) are summarized in Fig. 3 and Table 5. Of the 411 articles, 110 articles (26.8 %) were classified as Formal Theory/Literature review making it the most prevalent research strategy. This was followed by Sample Survey with 94 articles (or 22.9 %), Field Study – Secondary Data with 91 articles (22.1 %), Field Study – Primary Data with 66 articles (16.1 %), and Computer Simulation with 25 articles (6.1 %). These five research strategies composed 94 % of the articles in the sample. No articles were classified as a Judgment Task. So, the remaining three research strategies represented the remaining six percent of the sample which included Lab Experiment with 11 articles (2.7 %), Field Experiment with 11 articles (2.7 %), and Experimental Simulation with 3 articles (0.7 %).

Table 5 Articles per research strategy

Further analysis showing the research strategies over the 18 year period from 1994 to August 2011 (Table 6) illustrates that Formal Theory/Literature Review, Sample Survey, Field Study – Secondary Data, and Field Study – Primary Data are represented in almost every year of the timeframe. No articles were found in the years 1994 & 1996, and only one article was found in 1995. These four strategies are exploratory in nature and indicate the beginnings of a body of research (Scandura and Williams 2000). Further categorization and analysis of the articles with respect to Internet marketing topic categories was conducted in the third phase of this research project.

Table 6 Research strategy vs. year

Results of phase 3

Table 7 shows the number of articles per Internet marketing research topic category. These six categories provided a topic area classification for all of the 411 articles in our research sample. Of the 411 articles, 41.1 % were classified as ‘Business Models of Online Marketing’ making it the most prevalent Internet marketing topic category. This category was followed by ‘The Internet Advertising Landscape’ (22.4 %), ‘Evaluation of Online Performance’ (16.5 %), and ‘Other’ (10.0 %). These four research strategies accounted for 90 % of the articles in the sample. The topic categories titled ‘Commercial Exploitation of Web 2.0 in Consumer Marketing and in an Organizational Context’ and ‘The Future of Search Strategies’ represented the remaining six per cent (5.8 %) and four percent (4.1 %) of the articles. This illustration of the share of Internet marketing research that is represented by each category reveals the amount of attention topic categories of Internet marketing research have historically received among the top 30 IS journals.

Table 7 Articles per research topic

By plotting Internet marketing research topics against research strategies (Table 8), many of the gaps in Internet marketing research are exposed. The gaps are at the intersection of less used methodologies (Judgement Task, Experimental Simulation, Lab Experiment) and less studied domains in Internet marketing (Search Strategies and Web 2.0). We believe these gaps exist for two reasons. First, some of these research strategies are not prevalent in IS research, and some top IS journals do not accept papers that use unusual research strategies. So, researchers avoid unorthodox strategies. The reason some of these categories have not been studied is because they represent relatively new phenomena, and the research has not caught up with the business reality. The great news for researchers interested in Internet marketing is that this domain should provide research opportunities for years to come. To better illustrate the categorization process, Table 9 presents a sample of articles noting their corresponding research strategy and research topic. These articles were randomly selected as typical examples and are not meant to serve as hallmarks of a particular research strategy or research topic within Internet marketing research.

Table 8 Internet marketing topic vs. research strategy
Table 9 Sample of articles

About half (49 %) of the journal articles in this study use the Formal Theory/Literature Review and Sample Survey research strategies indicating the exploratory nature of the current research. We speculate the strategies used to study these topics were prevalent for several reasons. First, these strategies are the most appropriate for the early stages of research. In these exploratory years of Internet marketing research, formal theory/literature reviews are appropriate in order to determine what other strategies are being used in the research, define the topics under investigation, and find research in reference disciplines that are conducting similar research. Second, many researchers in business schools may prefer to administer sample surveys and field studies instead of laboratory experiment, experimental simulation, judgment task, and computer simulation because of the preferences for certain research strategies in the top journals in Information Systems and Marketing. Finally, organizations are less likely to commit to certain strategies (i.e. primary & secondary field studies and field experiments) because these strategies are more expensive for the organizations. These types of research strategies are very labour intensive to the organization being studied because records will need to be examined, personnel will need to be interviewed, and senior managers will be required to devote large amounts of their expensive time to help facilitate the research project. It is interesting to note that many of the articles coded as Field Study – Secondary and Computer Simulation used historical auction and pricing data freely available from the World Wide Web to avoid this issue.

Investigating the marketing literature

In order to investigate the Internet marketing research being conducted in the top Marketing Journals, we also performed a smaller literature review using the top five ranked marketing research journals following the same methodology previously described for the top 30 ranked IS journals. This list was compiled from three recent marketing journal rankings (Hofacker et al. 2009; Moussa and Touzani 2010; and Polonsky and Whitelaw 2006). The data pool included 24 articles, and after screening out irrelevant articles (book reviews, opinion pieces, etc.) the remaining 22 articles were categorized by research strategy and research topic (see Appendix B). Upon completion of the categorization process, we tabulated agreements and disagreements. Intercoder crude agreement (percent of agreement) was 95.4 % for research strategy and 90.9 % for research topic. Cohen’s Kappa could not be calculated because the sample size was too small. These two calculations were well within the acceptable ranges (Neuendorf 2002). The results of the literature review of the top five marketing journals are displayed in Tables 10 and 11.

Table 10 Internet marketing – top marketing journals
Table 11 Internet marketing topic vs. research strategy (marketing journals)

The number of articles published on the topic of Internet marketing in each of the top five ranked marketing journals is presented in Table 10. It is interesting to note that no articles were found in Journal of Consumer Research while 16 of the 22 (72.7 %) articles in the data pool were published in Marketing Science. This could indicate (a) Marketing Science is a top outlet for Internet marketing research or (b) the other Marketing journals use keywords other than “Internet marketing” to classify this area of research. The number of articles categorized based on both research strategy and research topic is presented in Table 11. The three research strategies with the largest number of articles among the top five marketing journals were “Formal Theory / Lit Review” (45.5 %), “Field Study - Secondary” (27.3 %), and “Field Study – Primary” (18.2 %). This indicates, like the research published in the top IS journals, the Internet marketing research published in the top marketing journals is also still in the exploratory stages.

Fourteen of the twenty-two articles (63.6 %) were categorized within the research topic labelled “the Internet Advertising Landscape” while no articles were categorized within the research topics “Commercial Exploitation of Web 2.0” or “Evaluation of Online Performance.” In contrast to the analysis of the top thirty ranked IS journals in which the top three research topics were “Business Models of Online Marketing” (41.1 %), “the Internet Advertising Landscape” (22.4 %), and Evaluation of Online Performance (16.5 %); the top three research topics within the top five marketing journals were “the Internet marketing Landscape” (63.6 %), “Business Models of Online Marketing” (13.6 %), and “Other Topics” (13.6 %). Due to the small number of articles in the sample, it is difficult to make any statements regarding trends in the Internet marketing research in the top Marketing journals.

Limitations and directions for future research

The current analysis of the Internet marketing literature is not without limitations and should be offset with future efforts. In summary, this literature review highlights the upward trend of Internet marketing research but also the limitations of both the research strategies employed and the topics investigated. The authors would suggest future literature reviews should expand article searches to full article text searches, search a broader domain of research outlets, and include other Internet marketing related search terms. Our literature analysis is meant to serve as a representative sample of articles and not a comprehensive or exhaustive analysis of the entire population of articles published on the topic of ‘Internet marketing.’ To further investigate this body of research, future research studies could explore the diversity of the Internet marketing research domain (Lee et al. 2007) or revisit Ngai and Wat’s (2002) electronic commerce literature review to assess the progress of that research stream. Other studies could take a more in depth look at the various business models or Internet advertising strategies associated with Internet marketing by reviewing the literature in areas such as electronic auctions, search strategies, social media, e-tailing, and various other research domains.

As Internet marketing continues to grow, future studies should consider the role of research relative to generalizability, precision of measure, and realism of context. Future research efforts should adopt more precise measures of what is occurring in this domain. Much of the research in our sample reports the new technologies and issues in Internet marketing without attempting to explain the fundamental issues of IS research. This is to be expected as this research domain appears to still be in the exploratory stages. For researchers to continue to attempt to answer the important questions in Internet marketing, future studies need to employ a wider variety of research strategies to investigate these important issues. Scandura and Williams (2000) stated that looking at research strategies employed over time by triangulation in a given subject area can provide useful insights into how theories are developing. In addition to the lack of variety in research strategy, very little triangulation has occurred during the timeframe used to conduct this literature review. This absence of coordinated theory development causes the research in Internet marketing to appear haphazard and unfocused.

However, the good news is that many of the research strategies and topics in this research are available for future research efforts. Of particular interest to researchers and practitioners would be studies observing consumer behaviour in real time using lab and field experiments or measuring purchasing behaviour from using stored click stream data in a secondary field study. We encourage researchers in fields of IS and Marketing to continue developing the body of research on this important topic using cross-disciplinary teams composed of researchers from business and the behavioural sciences. In addition, future studies could consider the six Internet marketing categories with respect to the research strategies. More specifically, each ‘zero’ appearing in Tables 8 and 11 represent gaps in the literature which provide countless opportunities for researchers to build upon the current body of published research. With this in mind, we hope this research analysis lays a foundation for developing a more complete body of knowledge relative to Internet marketing research within the fields of Information Systems and Marketing.