Role Of Theory Research

For this Discussion, you will

PART I

WHAT IS RESEARCH DESIGN?

1

THE CONTEXT OF DESIGN

Before examining types of research designs it is important to be clear about the role and purpose of research design. We need to understand what research design is and what it is not. We need to know where design fts into the whole research process from framing a question to fnally analysing and reporting data. This is the purpose of this chapter.

Description and explanation

Social researchers ask two fundamental types of research questions:

1 What is going on (descriptive research)? 2 Why is it going on (explanatory research)?

Descriptive research

Although some people dismiss descriptive research as ‘mere descrip­ tion’, good description is fundamental to the research enterprise and it has added immeasurably to our knowledge of the shape and nature of our society. Descriptive research encompasses much government spon­ sored research including the population census, the collection of a wide range of social indicators and economic information such as household expenditure patterns, time use studies, employment and crime statistics and the like.

Descriptions can be concrete or abstract. A relatively concrete descrip­ tion might describe the ethnic mix of a community, the changing age profle of a population or the gender mix of a workplace. Alternatively

 

 

2 WHAT IS RESEARCH DESIGN?

the description might ask more abstract questions such as ‘Is the level of social inequality increasing or declining?’, ‘How secular is society?’ or ‘How much poverty is there in this community?’

Accurate descriptions of the level of unemployment or poverty have historically played a key role in social policy reforms (Marsh, 1982). By demonstrating the existence of social problems, competent description can challenge accepted assumptions about the way things are and can provoke action.

Good description provokes the ‘why’ questions of explanatory research. If we detect greater social polarization over the last 20 years (i.e. the rich are getting richer and the poor are getting poorer) we are forced to ask ‘Why is this happening?’ But before asking ‘why?’ we must be sure about the fact and dimensions of the phenomenon of increasing polarization. It is all very well to develop elaborate theories as to why society might be more polarized now than in the recent past, but if the basic premise is wrong (i.e. society is not becoming more polarized) then attempts to explain a non­existent phenomenon are silly.

Of course description can degenerate to mindless fact gathering or what C.W. Mills (1959) called ‘abstracted empiricism’. There are plenty of examples of unfocused surveys and case studies that report trivial information and fail to provoke any ‘why’ questions or provide any basis for generalization. However, this is a function of inconsequential descriptions rather than an indictment of descriptive research itself.

Explanatory research

Explanatory research focuses on why questions. For example, it is one thing to describe the crime rate in a country, to examine trends over time or to compare the rates in different countries. It is quite a different thing to develop explanations about why the crime rate is as high as it is, why some types of crime are increasing or why the rate is higher in some countries than in others.

The way in which researchers develop research designs is funda­ mentally affected by whether the research question is descriptive or explanatory. It affects what information is collected. For example, if we want to explain why some people are more likely to be apprehended and convicted of crimes we need to have hunches about why this is so. We may have many possibly incompatible hunches and will need to collect information that enables us to see which hunches work best empirically.

Answering the ‘why’ questions involves developing causal explana­ tions. Causal explanations argue that phenomenon Y (e.g. income level) is affected by factor X (e.g. gender). Some causal explanations will be simple while others will be more complex. For example, we might argue that there is a direct effect of gender on income (i.e. simple gender discrimination) (Figure 1.1a). We might argue for a causal chain, such as that gender affects choice of feld of training which in turn affects

 

 

3 THE CONTEXT OF DESIGN

a) Direct causal relationship

Income level

Gender

b) Indirect causal relationship: a causal chain

Gender Field of training Occupation Promotion

opportunities Income

level

c) A more complex causal model of direct and indirect causal links

Gender

Child-care responsibility

Occupation

Part time or full time work

Income level

Field of training

Figure 1.1 Three types of causal relationships

occupational options, which are linked to opportunities for promotion, which in turn affect income level (Figure 1.1b). Or we could posit a more complex model involving a number of interrelated causal chains (Figure 1.1c).

PREDICTION, CORRELATION AND CAUSATION

People often confuse correlation with causation. Simply because one event follows another, or two factors co­vary, does not mean that one causes the other. The link between two events may be coincidental rather than causal.

There is a correlation between the number of fre engines at a fre and the amount of damage caused by the fre (the more fre engines the more damage). Is it therefore reasonable to conclude that the number of fre engines causes the amount of damage? Clearly the number of fre engines and the amount of damage will both be due to some third factor – such as the seriousness of the fre.

Similarly, as the divorce rate changed over the twentieth century the crime rate increased a few years later. But this does not mean that divorce causes crime. Rather than divorce causing crime, divorce and crime rates might both be due to other social processes such as secular­ ization, greater individualism or poverty.

 

 

4 WHAT IS RESEARCH DESIGN?

Students at fee paying private schools typically perform better in their fnal year of schooling than those at government funded schools. But this need not be because private schools produce better performance. It may be that attending a private school and better fnal­year performance are both the outcome of some other cause (see later discussion).

Confusing causation with correlation also confuses prediction with causation and prediction with explanation. Where two events or charac­ teristics are correlated we can predict one from the other. Knowing the type of school attended improves our capacity to predict academic achievement. But this does not mean that the school type affects aca­ demic achievement. Predicting performance on the basis of school type does not tell us why private school students do better. Good prediction does not depend on causal relationships. Nor does the ability to predict accurately demonstrate anything about causality.

Recognizing that causation is more than correlation highlights a problem. While we can observe correlation we cannot observe cause. We have to infer cause. These inferences however are ‘necessarily fallible . . . [they] are only indirectly linked to observables’ (Cook and Campbell, 1979: 10). Because our inferences are fallible we must minimize the chances of incorrectly saying that a relationship is causal when in fact it is not. One of the fundamental purposes of research design in explanatory research is to avoid invalid inferences.

DETERMINISTIC AND PROBABILISTIC CONCEPTS OF CAUSATION

There are two ways of thinking about causes: deterministically and probabilistically. The smoker who denies that tobacco causes cancer because he smokes heavily but has not contracted cancer illustrates deterministic causation. Probabilistic causation is illustrated by health authorities who point to the increased chances of cancer among smokers.

Deterministic causation is where variable X is said to cause Y if, and only if, X invariably produces Y. That is, when X is present then Y will ‘necessarily, inevitably and infallibly’ occur (Cook and Campbell, 1979: 14). This approach seeks to establish causal laws such as: whenever water is heated to 100 °C it always boils.

In reality laws are never this simple. They will always specify par­ ticular conditions under which that law operates. Indeed a great deal of scientifc investigation involves specifying the conditions under which particular laws operate. Thus, we might say that at sea level heating pure water to 100 °C will always cause water to boil.

Alternatively, the law might be stated in the form of ‘other things being equal’ then X will always produce Y. A deterministic version of the relationship between race and income level would say that other things being equal (age, education, personality, experience etc.) then a white person will [always] earn a higher income than a black person. That is, race (X) causes income level (Y).

 

http:cause.We

 

5 THE CONTEXT OF DESIGN

Stated like this the notion of deterministic causation in the social sciences sounds odd. It is hard to conceive of a characteristic or event that will invariably result in a given outcome even if a fairly tight set of conditions is specifed. The complexity of human social behaviour and the subjective, meaningful and voluntaristic components of human behaviour mean that it will never be possible to arrive at causal statements of the type ‘If X, and A and B, then Y will always follow.’

Most causal thinking in the social sciences is probabilistic rather than deterministic (Suppes, 1970). That is, we work at the level that a given factor increases (or decreases) the probability of a particular outcome, for example: being female increases the probability of working part time; race affects the probability of having a high status job.

We can improve probabilistic explanations by specifying conditions under which X is less likely and more likely to affect Y. But we will never achieve complete or deterministic explanations. Human behaviour is both willed and caused: there is a double­sided character to human social behaviour. People construct their social world and there are creative aspects to human action but this freedom and agency will always be constrained by the structures within which people live. Because behav­ iour is not simply determined we cannot achieve deterministic explana­ tions. However, because behaviour is constrained we can achieve probabilistic explanations. We can say that a given factor will increase the likelihood of a given outcome but there will never be certainty about outcomes.

Despite the probabilistic nature of causal statements in the social sciences, much popular, ideological and political discourse translates these into deterministic statements. Findings about the causal effects of class, gender or ethnicity, for example, are often read as if these factors invariably and completely produce particular outcomes. One could be forgiven for thinking that social science has demonstrated that gender completely and invariably determines position in society, roles in families, values and ways of relating to other people.

Theory testing and theory construction

Attempts to answer the ‘why’ questions in social science are theories. These theories vary in their complexity (how many variables and links), abstraction and scope. To understand the role of theory in empirical research it is useful to distinguish between two different styles of research: theory testing and theory building (Figure 1.2).

Theory building

Theory building is a process in which research begins with observations and uses inductive reasoning to derive a theory from these observations.

 

 

6 WHAT IS RESEARCH DESIGN?

Theory building approach

Empirical Start level here

Obs 1 Obs 2 Obs 3 Obs 4

Inductive reasoning Conceptual-abstract level

Theory testing approach

Conceptual-abstract Start

Theory

level here

Empirical level Obs 1 Obs 2 Obs 3 Obs 4

Figure 1.2 Theory building and theory testing approaches to research

These theories attempt to make sense of observations. Because the theory is produced after observations are made it is often called post factum theory (Merton, 1968) or ex post facto theorizing.

This form of theory building entails asking whether the observation is a particular case of a more general factor, or how the observation fts into a pattern or a story. For example, Durkheim observed that the suicide rate was higher among Protestants than Catholics. But is religious affliation a particular case of something more general? Of what more general phenomenon might it be an indicator? Are there other observations that shed light on this? He also observed that men were more suicidal than women, urban dwellers more than rural dwellers and the socially mobile more than the socially stable. He argued that the common factor behind all these observations was that those groups who were most suicidal were also less well socially integrated and experienced greater ambiguity about how to behave and what is right and wrong. He theorized that one of the explanations for suicidal behaviour was a sense of normlessness – a disconnectedness of individuals from their social world. Of course, there may have been other ways of accounting for these observations but at least Durkheim’s explanation was consistent with the facts.

Theory testing

In contrast, a theory testing approach begins with a theory and uses theory to guide which observations to make: it moves from the general to the particular. The observations should provide a test of the worth of the theory. Using deductive reasoning to derive a set of propositions from the theory does this. We need to develop these propositions so that

Deductive reasoning

Theory

 

 

7 THE CONTEXT OF DESIGN

Parents divorced?

No Yes

Low (a) (b)

Parental conflict

High (c) (d)

Figure 1.3 The relationship between divorce and parental conflict

if the theory is true then certain things should follow in the real world. We then assess whether these predictions are correct. If they are correct the theory is supported. If they do not hold up then the theory needs to be either rejected or modifed.

For example, we may wish to test the theory that it is not divorce itself that affects the wellbeing of children but the level of confict between parents. To test this idea we can make predictions about the wellbeing of children under different family conditions. For the simple theory that it is parental confict rather than divorce that affects a child’s wellbeing there are four basic ‘conditions’ (see Figure 1.3). For each ‘condition’ the theory would make different predictions about the level of children’s wellbeing that we can examine.

If the theory that it is parental confict rather than parental divorce is correct the following propositions should be supported:

• Proposition 1: children in situations (a) and (b) would be equally well off That is, where parental confict is low, children with divorced parents will do just as well as those whose parents are married.

• Proposition 2: children in situations (c) and (d) should be equally poorly off That is, children in confictual couple families will do just as badly as children in post­divorce families where parents sustain high confict.

• Proposition 3: children in situation (c) will do worse than those in situation (a) That is, those with married parents in high confict will do worse than those who have married parents who are not in confict.

• Proposition 4: children in situation (d) will do worse than those in situation (b) That is, those with divorced parents in high confict will do worse than those who have divorced parents who are not in confict.

• Proposition 5: children in situation (b) will do better than those in situation (c) That is, children with divorced parents who are not in confict will do better than those with married parents who are in confict.

• Proposition 6: children in situation (a) will do better than those in situation (d) That is, children with married parents who are not in confict will do better than those with divorced parents who are in confict.

 

 

8 WHAT IS RESEARCH DESIGN?

Starting point of theory testing

Theory

Implications for propositions

New theory

Inference

Analyse data

Deduction

Collect data

Starting point of theory building

Figure 1.4 The logic of the research process

No single proposition would provide a compelling test of the original theory. Indeed, taken on its own proposition 3, for example, would reveal nothing about the impact of divorce. However, taken as a pack­ age, the set of propositions provides a stronger test of the theory than any single proposition.

Although theory testing and theory building are often presented as alternative modes of research they should be part of one ongoing process (Figure 1.4). Typically, theory building will produce a plausible account or explanation of a set of observations. However, such explanations are frequently just one of a number of possible explanations that ft the data. While plausible they are not necessarily compelling. They require systematic testing where data are collected to specifcally evaluate how well the explanation holds when subjected to a range of crucial tests.

What is research design?

How is the term ‘research design’ to be used in this book? An analogy might help. When constructing a building there is no point ordering materials or setting critical dates for completion of project stages until we know what sort of building is being constructed. The frst decision is whether we need a high rise offce building, a factory for manufacturing machinery, a school, a residential home or an apartment block. Until this is done we cannot sketch a plan, obtain permits, work out a work schedule or order materials.

Propositions

Develop measures, sample etc.

 

 

9 THE CONTEXT OF DESIGN

Similarly, social research needs a design or a structure before data collection or analysis can commence. A research design is not just a work plan. A work plan details what has to be done to complete the project but the work plan will fow from the project’s research design. The function of a research design is to ensure that the evidence obtained enables us to answer the initial question as unambiguously as possible. Obtaining relevant evidence entails specifying the type of evidence needed to answer the research question, to test a theory, to evaluate a programme or to accurately describe some phenomenon. In other words, when designing research we need to ask: given this research question (or theory), what type of evidence is needed to answer the question (or test the theory) in a convincing way?

Research design ‘deals with a logical problem and not a logistical problem’ (Yin, 1989: 29). Before a builder or architect can develop a work plan or order materials they must frst establish the type of building required, its uses and the needs of the occupants. The work plan fows from this. Similarly, in social research the issues of sampling, method of data collection (e.g. questionnaire, observation, document analysis), design of questions are all subsidiary to the matter of ‘What evidence do I need to collect?’

Too often researchers design questionnaires or begin interviewing far too early – before thinking through what information they require to answer their research questions. Without attending to these research design matters at the beginning, the conclusions drawn will normally be weak and unconvincing and fail to answer the research question.

Design versus method

Research design is different from the method by which data are collected. Many research methods texts confuse research designs with methods. It is not uncommon to see research design treated as a mode of data collection rather than as a logical structure of the inquiry. But there is nothing intrinsic about any research design that requires a particular method of data collection. Although cross­sectional surveys are fre­ quently equated with questionnaires and case studies are often equated with participant observation (e.g. Whyte’s Street Corner Society, 1943), data for any design can be collected with any data collection method (Figure 1.5). How the data are collected is irrelevant to the logic of the design.

Failing to distinguish between design and method leads to poor evaluation of designs. Equating cross­sectional designs with question­ naires, or case studies with participant observation, means that the designs are often evaluated against the strengths and weaknesses of the method rather than their ability to draw relatively unambiguous conclu­ sions or to select between rival plausible hypotheses.

 

 

10 WHAT IS RESEARCH DESIGN?

Design type

Experiment Case study Longitudinal

design Cross-sectional

design

Method of data collection

Questionnaire Questionnaire Questionnaire Questionnaire

Interview Interview Interview Interview (structured or (structured or (structured or (structured or loosely loosely loosely loosely structured) structured) structured) structured)

Observation Observation Observation Observation

Analysis of Analysis of Analysis of Analysis of documents documents documents documents

Unobtrusive Unobtrusive Unobtrusive Unobtrusive methods methods methods methods

Figure 1.5 Relationship between research design and particular data collection methods

QUANTITATIVE AND QUALITATIVE RESEARCH

Similarly, designs are often equated with qualitative and quantitative research methods. Social surveys and experiments are frequently viewed as prime examples of quantitative research and are evaluated against the strengths and weaknesses of statistical, quantitative research methods and analysis. Case studies, on the other hand, are often seen as prime examples of qualitative research – which adopts an interpretive approach to data, studies ‘things’ within their context and considers the subjective meanings that people bring to their situation.

It is erroneous to equate a particular research design with either quantitative or qualitative methods. Yin (1993), a respected authority on case study design, has stressed the irrelevance of the quantitative/ qualitative distinction for case studies. He points out that:

 

 

11 THE CONTEXT OF DESIGN

a point of confusion . . . has been the unfortunate linking between the case study method and certain types of data collection – for example those focusing on qualitative methods, ethnography, or participant observation. People have thought that the case study method required them to embrace these data collection methods . . . On the contrary, the method does not imply any particular form of data collection – which can be qualitative or quantitative. (1993: 32)

Similarly, Marsh (1982) argues that quantitative surveys can provide information and explanations that are ‘adequate at the level of meaning’. While recognizing that survey research has not always been good at tapping the subjective dimension of behaviour, she argues that:

Making sense of social action . . . is . . . hard and surveys have not traditionally been very good at it. The earliest survey researchers started a tradition . . . of bringing the meaning from outside, either by making use of the researcher’s stock of plausible explanations . . . or by bringing it from subsidiary in­depth interviews sprinkling quotes . . . liberally on the raw correlations derived from the survey. Survey research became much more exciting . . . when it began including meaningful dimensions in the study design. [This has been done in] two ways, frstly [by] asking the actor either for her reasons directly, or to supply information about the central values in her life around which we may assume she is orienting her life. [This] involves collecting a suffciently complete picture of the context in which an actor fnds herself that a team of outsiders may read off the meaningful dimensions. (1982: 123-4)

Adopting a sceptical approach to explanations

The need for research design stems from a sceptical approach to research and a view that scientifc knowledge must always be provisional. The purpose of research design is to reduce the ambiguity of much research evidence.

We can always fnd some evidence consistent with almost any theory. However, we should be sceptical of the evidence, and rather than seeking evidence that is consistent with our theory we should seek evidence that provides a compelling test of the theory.

There are two related strategies for doing this: eliminating rival explanations of the evidence and deliberately seeking evidence that could disprove the theory.

PLAUSIBLE RIVAL HYPOTHESES

A fundamental strategy of social research involves evaluating ‘plausible rival hypotheses’. We need to examine and evaluate alternative ways of explaining a particular phenomenon. This applies regardless of whether the data are quantitative or qualitative; regardless of the particular research design (experimental, cross­sectional, longitudinal or case

 

 

12 WHAT IS RESEARCH DESIGN?

Causal relationship

Academic School type

achievement

Alternative explanation: selectivity on child’s initial ability

Child’s ability

School type

Academic achievement

Alternative explanation: family resources

Facilities in home for studyParental

resources Academic

achievement

School type

Alternative explanation: educational values

Child’s valuation of

Parental education Academic valuation of achievement education

School type

Figure 1.6 Causal and non-causal explanations of the relationship between school type and academic achievement

study); and regardless of the method of data collection (e.g. observation, questionnaire). Our mindset needs to anticipate alternative ways of interpreting fndings and to regard any interpretation of these fndings as provisional – subject to further testing.

The idea of evaluating plausible rival hypotheses can be illustrated using the example of the correlation between type of school attended and academic achievement. Many parents accept the causal proposition that attendance at fee paying private schools improves a child’s academic performance (Figure 1.6). Schools themselves promote the same notion by prominently advertising their pass rates and comparing them with those of other schools or with national averages. By implication they propose a causal connection: ‘Send your child to our school and they will pass (or get grades to gain entry into prestigious institutions, courses).’ The data they provide are consistent with their proposition that these schools produce better results.

 

 

13 THE CONTEXT OF DESIGN

But these data are not compelling. There are at least three other ways of accounting for this correlation without accepting the causal link between school type and achievement (Figure 1.6). There is the selectivity explanation: the more able students may be sent to fee paying private schools in the frst place. There is the family resources explanation: parents who can afford to send their children to fee paying private schools can also afford other help (e.g. books, private tutoring, quiet study space, computers). It is this help rather than the type of school that produces the better performance of private school students. Finally, there is the family values explanation: parents who value education most are prepared to send their children to fee paying private schools and it is this family emphasis on education, not the schools themselves, that produces the better academic performance. All these explanations are equally con­ sistent with the observation that private school students do better than government school students. Without collecting further evidence we cannot choose between these explanations and therefore must remain open minded about which one makes most empirical sense.

There might also be methodological explanations for the fnding that private school students perform better academically. These methodolo­ gical issues might undermine any argument that a causal connection exists. Are the results due to questionable ways of measuring achieve­ ment? From what range and number of schools were the data obtained? On how many cases are the conclusions based? Could the pattern simply be a function of chance? These are all possible alternative explanations for the fnding that private school students perform better.

Good research design will anticipate competing explanations before collecting data so that relevant information for evaluating the relative merits of these competing explanations is obtained. In this example of schools and academic achievement, thinking about alternative plausible hypotheses beforehand would lead us to fnd out about the parents’ fnancial resources, the study resources available in the home, the parents’ and child’s attitudes about education and the child’s academic abilities before entering the school.

The fallacy of affrming the consequent Although evidence may be con­ sistent with an initial proposition it might be equally consistent with a range of alternative propositions. Too often people do not even think of the alternative hypotheses and simply conclude that since the evidence is consistent with their theory then the theory is true. This form of reasoning commits the logical fallacy of affrming the consequent. This form of reasoning has the following logical structure:

If A is true then B should follow. • •

We observe B.

• Therefore A is true.

 

 

14 WHAT IS RESEARCH DESIGN?

If we apply this logic to the type of school and achievement proposition, the logical structure of the school type and achievement argument becomes clearer.

Initial proposition:

• Private schools produce better students than do government schools.

The test:

• If A then B If private schools produce better students (A) then their students should get better fnal marks than those from government funded schools (B).

• B is true Private school students do achieve better fnal marks than government school students (observe B).

• Therefore A is true Therefore private schools do produce better students (A is true).

But as I have already argued, the better performance of private school students might also refect the effect of other factors. The problem here is that any number of explanations may be correct and the evidence does not help rule out many of these. For the social scientist this level of indeterminacy is quite unsatisfactory. In effect we are only in a position to say:

• If A [or C, or D, or E, or F, or . . .] then B. • We observe B. • Therefore A [or C, or D, or E, or F, or . . .] is true.

Although explanation (A) is still in the running because it is consistent with the observations, we cannot say that it is the most plausible explanation. We need to test our proposition more thoroughly by evaluating the worth of the alternative propositions.

FALSIFCATION: LOOKING FOR EVIDENCE TO DISPROVE THE THEORY

As well as evaluating and eliminating alternative explanations we should rigorously evaluate our own theories. Rather than asking ‘What evidence would constitute support for the theory?’, ask ‘What evidence would convince me that the theory is wrong?’ It is not diffcult to fnd evidence consistent with a theory. It is much tougher for a theory to survive the test of people trying to disprove it.

Unfortunately some theories are closed systems in which any evidence can be interpreted as support for the theory. Such theories are said to be non­falsifable. Many religions or belief systems can become closed systems whereby all evidence can be accommodated by the theory and

 

 

15 THE CONTEXT OF DESIGN

nothing will change the mind of the true believer. Exchange theory (Homans, 1961; Blau, 1964) is largely non­falsifable. It assumes that we always maximize our gains and avoid costs. But we can see almost anything as a gain. Great sacrifces to care for a disabled relative can be interpreted as a gain (satisfaction of helping) rather than a loss (income, time for self etc.). We need to frame our propositions and defne our terms in such a way that they are capable of being disproven.

THE PROVISIONAL NATURE OF SUPPORT FOR THEORIES

Even where the theory is corroborated and has survived attempts to disprove it, the theory remains provisional:

falsifcationism stresses the ambiguity of confrmation . . . corroboration gives only the comfort that the theory has been tested and survived the test, that even after the most impressive corroborations of predictions it has only achieved the status of ‘not yet disconfrmed’. This . . . is far from the status of ‘being true’. (Cook and Campbell, 1979: 20)

There always may be an unthought­of explanation. We cannot anticipate or evaluate every possible explanation. The more alternative explana­ tions that have been eliminated and the more we have tried to disprove our theory, the more confdence we will have in it, but we should avoid thinking that it is proven.

However we can disprove a theory. The logic of this is:

• If theory A is true then B should follow. • B does not follow. • Therefore A is not true.

So long as B is a valid test of A the absence of B should make us reject or revise the theory. In reality, we would not reject a theory simply because a single fact or observation does not ft. Before rejecting a plausible theory we would require multiple disconfrmations using different measures, different samples and different methods of data collection and analysis.

In summary, we should adopt a sceptical approach to explanations. We should anticipate rival interpretations and collect data to enable the winnowing out of the weaker explanations and the identifcation of which alternative theories make most empirical sense. We also need to ask what data would challenge the explanation and collect data to evaluate the theory from this more demanding perspective.

 

 

16 WHAT IS RESEARCH DESIGN?

Summary

This chapter has outlined the purpose of research design in both descrip­ tive and explanatory research. In explanatory research the purpose is to develop and evaluate causal theories. The probabilistic nature of causation in social sciences, as opposed to deterministic causation, was discussed.

Research design is not related to any particular method of collecting data or any particular type of data. Any research design can, in principle, use any type of data collection method and can use either quantitative or qualitative data. Research design refers to the structure of an enquiry: it is a logical matter rather than a logistical one.

It has been argued that the central role of research design is to minimize the chance of drawing incorrect causal inferences from data. Design is a logical task undertaken to ensure that the evidence collected enables us to answer questions or to test theories as unambiguously as possible. When designing research it is essential that we identify the type of evidence required to answer the research question in a convincing way. This means that we must not simply collect evidence that is con­ sistent with a particular theory or explanation. Research needs to be structured in such a way that the evidence also bears on alternative rival explanations and enables us to identify which of the competing explana­ tions is most compelling empirically. It also means that we must not simply look for evidence that supports our favourite theory: we should also look for evidence that has the potential to disprove our preferred explanations.

consider the role of theory in research and the relationship between theory and philosophical orientations. You will also familiarize yourself with a theory in your field so that you may become more conversant in your discipline’s theoretical foundations.

Post an explanation of the role of theory in research. Next, identify a theory in your discipline and explain its basic tenets. Then, with this theory in mind, consider your answer to the following question posed by Drs. Burkholder and Burbank in last week’s reading: “What do I have to believe about the world and about human beings in order for me to accept or use this theory?” (p. 27).  Finally, describe the extent to which the epistemological and ontological assumptions of your chosen theory align with the philosophical orientation that reflects your worldview.

 

  • Explain role of theory in research
  • Use research databases and scholarly sources to identity a theory in your discipline
  • Explain basic tenets of a theory
  • Describe alignment between epistemological and ontological assumptions of a theory and philosophical orientations
  • Apply APA Style to writing

Be sure to support your Main Issue Post and Response Post with reference to the week’s Learning Resources and other scholarly evidence in APA Style.

 

Burkholder, G. J., Cox, K. A., Crawford, L. M., & Hitchcock, J.H. (Eds.) (2020). Research design and methods: An applied guide for the scholar-practitioner. SAGE Publications, Inc.

  • Chapter 3, “Conceptual and Theoretical Frameworks in Research”

Babbie, E. (2017). Basics of social research (7th ed.). Boston, MA: Cengage Learning.

  • Chapter 2, “Paradigms, Theory, and Research”

https://academicguides.waldenu.edu/library/theory

A description of at least three ethical issues including multicultural and diversity issues

Write a 1,000 – 1,250-word paper discussing codes of practice and ethical issues that must be considered when using psychological assessments. Address the following in your paper:

  • A description of at least three ethical issues including multicultural and diversity issues
  • Ways to avoid the ethical issues in psychological assessments
  • A discussion of how a cl

    Submission Ide: 8b4e2be8-8d4e-47af-9182-824c4f7f5d45

    87% SIMILARITY SCORE 1   CITATION ITEM 5   GRAMMAR ISSUES 0   FEEDBACK COMMENT Internet Source   0% Institution   87%

    Jennifer Rizzo

    1 Codes_of_Practice_and_Ethical_Issues_in_The_Use_of_Psychological_Assessment.docx

     

    Summary

     1082 Words

    Running head: CODES OF PRACTICE AND ETHICAL ISSUES IN THE USE OF PSYCHOLOGICAL ASSESSMENT 1

    CODES OF PRACTICE AND ETHICAL ISSUES IN THE USE OF PSYCHOLOGICAL ASSESSMENT 2

    Codes of Practice and Ethical Issues in The Use of Psychological Assessment

    Psychological assessment refers to the combination of the techniques that help the

    psychologist determine the hypothesis of individual behavior and capabilities. The process

     Duplicated ph…: Psychological…  Psychological…

    Codes of Practice and Ethical Issues in The Use of Psychological Assessment

    Student’s name: Jennifer Rizzo

    Institutional Affiliation: Grand Canyon University

    Professor’s Name: Dr. Weber

    Course Name: CNL 523

    Date: 12/08/2020

     

     

    involves four components given under some conditions. The testing is done through a scale of

    measurement leading to the analysis of the individual differences, therefore, psychological

    concept. Some observations are made to help provide valuable information.

    Finally, informal assessments are added to the standardized norm-referenced tests to help

    supplement the procedures. Ethics is also crucial for professionalism, as it is the guiding

    principle of how work should be conducted. Psychology as a profession also requires that ethics

    adhere to fulfilling its primary mandate of developing a treatment plan (Kingdon, 2019) . all

    psychologists need to ensure that they incorporate the highest ethical standards in their daily

    activities.

    There are various ethical issues to consider in these assessments, including

    confidentiality, integrity, and privacy issues. Psychologists ought to have respect for their clients.

    This would ensure that they are within the guidelines provided by the code of ethics they are

    guided by. This includes respect for the rights and dignity of the people, propriety rights, and

    integrity. The code of ethics guides psychologists. This code has the guidelines in which the

    professionals are guided when conducting psychological assessment and tests. It is important to

    have a code of conduct as it leads to safeguarding the clients’ rights. It also helps protect their

    welfare, thus ensure that there is integrity while conducting the assessments.

    Psychologists regard people as very valuable as they are their clients, hence respecting

    their rights being paramount, which involved the right to autonomy and justice. Psychologists

    CODES OF PRACTICE AND ETHICAL ISSUES IN THE USE OF PSYCHOLOGICAL ASSESSMENT 3

    also serve people from diverse backgrounds, thus the need to promote equality and equity. This

    can be achieved through the professional guidance they give their clients, promoting human

    rights, including oral and legal rights (Dean, 2010). This would lead to a society that respects the

    dignity of all people from different backgrounds.

    While handling people from different backgrounds, psychologists face various ethical

    issues. This includes having respect for their clients, as some might undergo limitations when

    using the English language. When faced with this ethical dilemma, the psychologist sue

    informed consent to explain the limitation to confidentiality that this situation could cause. This

    is because the psychologist would need to get a third party to ensure that there is communication

    between them hence limiting the confidentiality. There would be a need to seek advice on

    relevant cultural consultants, thus improving the communication between the two. There would

    be a need to assess the client’s background to understand them more, thus creating a good rapport

    (Donna Palladino, 2019) . This would lead to overcoming the language or cultural bias, leading to

    communication between the client and the psychologist.

    Psychologists would also be needed to be mindful of the clients’ previous experiences.

    This would entail assessing the cognitive functioning for the cultural and linguistic diverse

    clients hence adopting suitable assessment tools. They should also clarify the correct methods to

    be applied in the assessment. The purpose of the assessment, the process itself, the disclosure of

     Student: Submitted to Grand Canyon University

     Checks that a sentence starts wit…: all  All

     Passive voice: be needed to be

     

     

    the client’s information, how the storing of the information would be conducted, and how the

    information would be stored even after a treatment plan is made. These were the privacy and

    confidentiality of ethical issues to be considered when handling a client.

    CODES OF PRACTICE AND ETHICAL ISSUES IN THE USE OF PSYCHOLOGICAL ASSESSMENT 4

    CODES OF PRACTICE AND ETHICAL ISSUES IN THE USE OF PSYCHOLOGICAL ASSESSMENT 5

    when it came to assessments (Peters, 2015). This would entail being competent when they get in

    contact with the clients from using the procedures, applying to the individuals and groups,

    preparing reports, and even communicating the results. This would ensure that the psychological

    processes and assessment is successful.

     Spelling mist…: psychometrica…  psycho metric…

     Statistically detect wr…: accessed  assessed

    Psychologists should also ensure that there is competence when handling their clients.

    The services that they offer should not harm their clients but instead, be of benefit to them. They

    ought to protect their client’s interests by ensuring that there are privacy and confidentiality.

    They should assess their clients well before they embark on the psychological assessment. This

    by conducting a background check to see if there were any previous assessment data and if it

    would be relevant to the current assessment. There should also be the correct procedures that

    include psychometrical and proper assessment, hence adapting to the cultural difference they

    may encounter.

    Psychologists should also ensure that the records of information relating to the client

    should be kept in the right manner. There should also be integrity when dealing with the

    assessment data by ensuring that the techniques used are transparent, hence satisfying the clients.

    The record-keeping process needs competence and professional responsibility; thus, the shared

    information should not be accessed with a third only with permission from the client hence

    confidentiality. They should also act in a reputable behavior, ensuring no conflict of interest

    when dealing with their clients. There should be a non-exploitation of the clients hence ensuring

    the highest standards of professionalism. The clients’ career development, social and personal

    development also impact the assessment choice that a psychologist could use. When they have a

    higher educational background, they would be easy to handle as their grasping of issues would

    be of a higher affinity than a client with less educational background.

    Psychologists must then practice while adhering to the ethics code of conduct. They

    ought to embrace ethical commitment, which involves using their knowledge and skills to help

    them in the assessment process, thus being aware comprehensively of their clients’ rights. They

    ought to exercise a duty of care while handling their clients, thus utilizing their ethical expertise

     

     

    CODES OF PRACTICE AND ETHICAL ISSUES IN THE USE OF PSYCHOLOGICAL ASSESSMENT 6

    References

    Dean, D. (2010). Clinical Competency and ethics in Psychology. Inquiries Journal.

    Donna Palladino, G. S. (2019). Ethical Issues in Testing and Assessment. Springer Link.

    Issues in the Assessment and Diagnosis of Culturally Diverse Individuals. (n.d.). Retrieved from

    http://losangeles.networkofcare.org/mh/library/article.aspx?id=339

    Kingdon, M. (2019). The Importance of Ethics in psychology. Studying Psychology.

    Peters, J. (2015). Ethical Issues in Psychology. Psych Yogi.

     

     

     

    CODES OF PRACTICE AND ETHICAL ISSUES IN THE USE OF PSYCHOLOGICAL ASSESSMENT 7

    inician assesses behaviors that stem from cultures or subcultures

  • A discussion of how a client’s academic/education, career, personal, and social development impacts assessment choice

Include a discussion of how these ethical issues are addressed in “Section E: Evaluation, Assessment, and Interpretation” from the American Counseling Association Code of Ethics.

Include at least three scholarly references in addition to the textbook in your paper.

Prepare this assignment according to the guidelines found in the APA Style Guide, located in the Student Success Center. An abstract is not required.

This assignment uses a rubric. Please review the rubric prior to beginning the assignment to become familiar with the expectations for successful completion.

Prosocial Behavior, Power Point Slides

Week 7: Assignment: Prosocial Behavior

Top of Form

Hide Assignment Information

Turnitin®

Turnitin® enabledThis assignment will be submitted to Turnitin®.

Instructions

Week 7 Exercise: Prosocial Behavior

Much of what we tend to focus on when we study social psychology are topics that often have a negative connotation such as conformity, prejudice, aggression or obedience. A huge component of the study of social psychology; however, focuses on prosocial behavior – behaviors that focus on compassion and helping others. For this activity, you will focus on this more uplifting aspect of social psychology. Topics that fall under the area of prosocial behavior include altruism, helping, bystander intervention, empathy, and compassion, among others.

For this exercise, pick one day and seek to structure your thoughts and behaviors entirely around helping others. With each interaction or action you take, pause to think and ask yourself “is there a way I might help another here?” Hold a door for someone, offer your seat, share a smile, give a sincere compliment, show empathy to another, attempt to be more patient or understanding, etc. Your efforts should be in social settings that involve interactions with others (rather than something such as donating to a charity for instance). The goal is to be as thoughtfully prosocial in your interactions throughout the day as possible.

· At the beginning of the day, jot down your general mood, feelings, attitude, etc.

· Then throughout the day, whenever possible, carry a small notebook with you or make notes in an app on your phone to jot down meaningful encounters or experiences as you attempt to engage in prosocial behaviors.

· At the end of the day, again reflect and take notes on how you feel, your general mood, feelings and attitudes, etc.

PLEASE NOTE: If you are unable to engage in prosocial behavior outside of your home due to COVID-19 restrictions/precautions, you are encouraged to engage in such behaviors with your family/people with whom you are sheltering. You may also engage in prosocial behavior with others virtually or through other means (e.g., through video calls, emails, etc…). This assignment will be more meaningful if you are able to engage in-person with acquaintances or strangers, but you can still find ways to make a significant difference to others even if quarantined or sheltering in place.

In a 5-7 slide PowerPoint presentation, not counting title or reference slides:

· Summarize your experience. Describe the prosocial behaviors you engaged in, others’ reactions to these behaviors, and your assessment of any changes in mood, attitude, good fortune, or anything else of note you experienced.

· Review what you have learned about human behavior in social settings this week in your readings. Connect what you learned or experienced through your day of conscious, prosocial behavior with the terms, concepts, and theories from your research. Integrate at least two academic sources (your assigned readings/resources can comprise one of these sources), citing any references used in APA format.

· Describe any new insights you gained through this experience about your interactions with others on a daily basis, including any behaviors you wish to change or to continue.

· Use the features of PowerPoint to your advantage to communicate your ideas – include pictures, audio recorded narration, speaker’s notes, video, links, etc. as appropriate to enhance your ideas.

· Include an APA formatted title slide and reference slide. APA components such as an abstract, headings, etc. are not required since this is a PowerPoint presentation.

Submit your presentation as an attachment in the Week 7 Assignment Prosocial Behavior link in the Assignments area of the classroom no later than 11:55 pm EST Sunday of Week 7.

Due Date

Feb 21, 2021 11:59 PM

Hide Rubrics

Rubric Name: PSYC101 Week 7 Assign. Rubric: Prosocial Behavior

This table lists criteria and criteria group name in the first column. The first row lists level names and includes scores if the rubric uses a numeric scoring method.Criteria

Exemplary

Accomplished

Developing

Beginning

Did not attempt

Criterion Score

Description of Behaviors and Impact

33 points

Student provides a detailed, insightful description of prosocial behavior, reactions and impact on others.

28.05 points

Student provides a complete description of prosocial behavior, reactions and impact on others.

24.75 points

Student provides a marginal description of prosocial behavior, reactions and impact on others.

21.45 points

Student attempts to provide a description of prosocial behavior, reactions and impact on others but description does not demonstrate an understanding of the concepts.

0 points

Student does not describe prosocial behavior, reactions or impact on others.

/ 33

Connection to Theory

33 points

Student provides an accurate, thorough description of the connections between experiences and relevant psychological theory using many examples from the literature.

28.05 points

Student provides a mostly accurate description of the connections between experiences and relevant psychological theory using at least two examples from the literature.

24.75 points

Student provides a marginal description of the connections between experiences and relevant psychological theory using at least one example from the literature.

21.45 points

Student attempts to provide a description of the connections between experiences and relevant psychological theory but does not use examples from the literature for support.

0 points

Student does not provide a description of the connections between experiences and relevant psychological theory.

/ 33

Behavioral Insights

14 points

Student provides an insightful discussion of how the information gleaned will impact future behaviors.

11.9 points

Student provides a discussion of how the information gleaned will impact future behaviors.

10.5 points

Student provides a marginal discussion of how the information gleaned will impact future behaviors.

9.1 points

Student attempts to provide a discussion of how the information gleaned will impact future behaviors, but discussion does not demonstrate an understanding of the concepts.

0 points

Student does not provide a discussion of how the information gleaned will impact future behaviors.

/ 14

Formatting/Writing

20 points

Work is presented in a logical and coherent way. Writing is clear, articulate, and error free. Citations are composed in proper format with few or no errors. Powerpoint is engaging and visually effective.

17 points

Work is grammatically sound with a few minor errors. Citations are composed in the proper format with some errors. Powerpoint is used effectively.

15 points

Work contains frequent grammatical errors. Citations are inaccurate or improperly formatted. Presentation is somewhat hard to follow and/or does not make effective use of common features (images, bullet points, speaker’s notes, etc.).

13 points

Writing errors are so prevalent as to interfere with understanding of the content. Presentation is confusing, hard to read, and difficult to follow.

0 points

Work does not demonstrate appropriate undergraduate level writing. Presentation is not included.

/ 20

Rubric Total ScoreTotal

/ 100

Bottom of Form

Complete the Scholarly Article Content Analysis Worksheet for the Hass & Ray (2020) article.

It is important that the worksheet is completed and the questions below are answered.

Assignment

  • Complete the S

    COUN 6626: Research Methodology and Program Evaluation

    Week 4 Scholarly Article Content Analysis

    Case Conceptualization:

    Orion is a 4-year-old African American child. He comes into counseling referred by his primary pediatrician. Orion has been diagnosed with an autism spectrum disorder. He has difficulty with communication, has deficits in empathizing with others’ intentions, and struggles with single-mindedness. Orion’s parents and preschool teacher have noticed a pervasive pattern of emotional dysregulation which includes frequent episodes of hysterical crying. Orion’s parents are concerned that he is not going to be promoted to kindergarten next year if he does not improve his ability to relate positively with others and improve his ability to regulate his emotions.

     

    Article:

    Haas, S. C., & Ray, D. C. (2020, July 6). Child-Centered Play Therapy With Children Affected by

    Adverse Childhood Experiences: A Single-Case Design. International Journal of Play Therapy.

    Advance online publication. http://dx.doi.org/10.1037/pla0000135

     

    1. Is the article above a peer-reviewed, scholarly source?

     

    Tip: Peer review is part of the editorial process an article goes through before it is published in a peer-reviewed journal. Once an article is submitted to a peer-reviewed journal, the journal editors send that article to “peers” or scholars in the field to evaluate the article. To determine if a journal is peer reviewed (also sometimes called refereed journals), try one or both of these steps:

    · Look up the journal in the UlrichsWeb.com (available on the A-Z Database List) and determine whether it is identified as peer reviewedUlrich’s is a directory. It is a searchable list of periodicals (magazines, journals, newspapers, etc.). It provides information about each periodical such as publisher, scope, and whether the journal uses peer review. 

    · Examine the journal’s website and review the submission and editorial process for evidence of peer review.

     

    2. What is the (a) problem the researchers were investigating/purpose of the research and (b) research question the researchers were trying to answer? This is a 2 part question.

    Tip: All studies have a research question that drives the investigation (what the researchers are trying to learn). Sometimes this is formally stated while other times the reader must discover this information which can usually be found in the Abstract or the Introduction section. Usually there is a section that is named “Purpose of the study”. The Results section or the Discussion section will provide the answer(s) to the research question. Research studies can use either quantitative, qualitative or mixed methods to investigate the question. Sometimes researchers are investigating more than one intervention and so research questions may include multiple parts. Be sure to review all parts of the inquiry or use multiple questions to explain.

     

    3. Describe the sample/participants in the study. Be sure to include how many participants were included in the study.

     

    Tip: Participants are also known as the sample. Quantitative studies generally have larger samples sizes than qualitative studies. Case studies may have one main “case” which may include a single person, a family, a group, or community. You want to describe who (e.g., demographics) and how many persons participated in the study.

    4. Did the researchers secure permission to conduct the study and/or secure informed consent from the participants? Were there any cultural concerns noted or do you have any concerns about bias?

     

    TipCultural considerations are related to research procedures. Consider whether there were cultural elements that may have changed the way the study took place such as language barriers, the need for an interpreter, and whether the sample matches the population that the researchers say they are studying.

    The key is to consider what cultural factors are pertinent to the research question. If you say you are studying an intervention for depression, the sample needs to include persons with depression. If a study is not specific to race or gender, for example, that does not make it culturally insensitive if the researches didn’t set out to learn about that intervention specifically applied to race or gender.

     

    5. Identify exactly what data was collected by the researchers in the study.

    Is the data quantitative (numeric data such as scores on assessments like the Iowa Basic Skills Test (IBST) or the Beck Depression Inventory (BDI)? If there are assessment instruments used – are they numerical results or narrative results?

    Is the data qualitative (for example, clinical intake interviews or a narrative behavioral observation?

    image1

    Tip: The variables (e.g., substance abuse) or characteristic (e.g., geographic location) being investigated is usually found in the Introduction and Method sections (and sometimes the Abstract). For example: if a researcher is investigating an intervention for the treatment of depression. The variable may be “level of depression” and the data collected could be scores on the Beck Depression Scale.

    All data points represent something the researcher is trying to investigate. Data can be quantitative (like a measurement, frequency, or score that is represented by a numeral) or qualitative (data captured using written or spoken words, observations or photos). This includes things like student academic or behavioral records, historical documents, records, or artifacts like diaries or case notes.

     

    6. What was the outcome or the general result of the research study?

    What is the answer to the research question?

    image2

    Tip: The Discussion section is where what the authors present how the results can be applied when working with clients or students. The authors will articulate their greatest take away from the study outcomes and what they view as most important to know to meet the needs of clients or students with similar needs.

     

    7. Based on your understanding of the results of the research study presented, discuss how the outcomes can be generally applied to your future counseling practice.

    image3

    Tip: The authors identify if the results of the investigation support their hypothesis and present the major findings. The Results section and the Discussion section present the answer to the question the researchers were trying to learn. Keep in mind that when you are investigating an intervention, the results could be mixed. In other words, the intervention might be successful, not successful, or partially successful.

     

    8. How does this research article apply to the case study at the top of the worksheet?

    image4

    Tip: While there are similarities and differences between the article and the case study on the worksheet, describe how the general outcomes from the article relate to the case study. Explain your insights into how the information from the article could be useful to meet the needs of the case study.

    NOTE: As a counselor, what did you interpret from the outcomes of the research study in the article that you could use in developing treatment goals or action plans for the child in the case study on the worksheet?

     

    Your Answer here should include the steps and process you took to find the selected research article. Explain how you know your selected article is peer reviewed.

     

    Your Answer here should include details about the participants, or information about the population (sample) used in the research study.

     

    Your Answer here should provide a snapshot of the participants.

     

     

    © 2020 Walden University 1

    cholarly Article Content Analysis Worksheet for the Hass & Ray (2020) article.

  • Analyze the contents of the article and apply the findings to the case conceptualization included in the worksheet.
  • Critically analyze the article and identify all components:
    • Is the article scholarly?
    • What is the problem/purpose?
    • What is(are) the research question(s)?
    • Who are the participants?
    • What are the ethical/cultural considerations?
    • What data /information was collected from participants?
    • How did the researchers describe the results/answer to the research question?
    • How does this research apply to the case study?

Be sure to support your Assignment by citing all resources including those in the Learning Resources. Use proper APA format and citations.