Study of Chinese Learners' Pedagogical Choices in Korean
In addition to the learner-internal aspects CLKs' understanding of the need to be pragmatic and the relational affordances they were able to draw from were crucial. Researchers from TS and ZL, for example mentioned their relationship with their local professor as a major factor in their pragmatic decision to avoid criticizing a strict professor (see the example 2).
This article reviews all local practical research on Korean up to 2020. It focuses on the practical fundamental topics like:
Discourse Construction Tests
The test for discourse completion (DCT) is an instrument that is widely used in pragmatic research. It has numerous advantages however, it also has its drawbacks. For instance the DCT cannot account for cultural and individual differences in communication. The DCT can also be biased and can lead to overgeneralizations. Therefore, it is important to analyze it carefully prior to using it for research or assessment purposes.
Despite its limitations, the DCT is a useful tool to investigate the connection between prosody, information structure, and non-native speakers. The ability to manipulate the social variables that are relevant to the manner of speaking in two or more steps can be a plus. This feature can be used to study the effect of prosody in different cultural contexts.
In the field of linguistics, the DCT has emerged as one of the most significant instruments for analyzing learners' communication behaviors. It can be used to investigate numerous issues, like manner of speaking, turn-taking, and lexical choices. It can also be used to assess the phonological difficulty of learners their speech.
A recent study employed an DCT to assess EFL students' refusal skills. Participants were given a set of scenarios to choose from, and then asked to select the most appropriate response. The researchers found the DCT to be more effective than other refusal methods like the use of a questionnaire or video recordings. However, they cautioned that the DCT should be employed with caution and include other methods for collecting data.
DCTs can be designed with specific language requirements, like form and content. These criteria are based on intuition and is based on the assumptions made by the test developers. They are not necessarily correct, and they could misrepresent the way that ELF learners actually reject requests in actual interactions. 프라그마틱 슬롯 requires more research on alternative methods of measuring refusal competence.
In a recent study DCT responses to student requests via email were compared with the responses from an oral DCT. The results showed that the DCT promoted more direct and traditionally indirect request forms and made a less frequent use of hints than email data did.
Metapragmatic Questionnaires (MQs)
This study looked at Chinese learners' pragmatic choices when using Korean. It used various experimental tools including Discourse Completion Tasks, metapragmatic questions and Refusal Interviews. Participants were 46 CLKs of upper-intermediate who participated in DCTs, MQs, and RIs. They were also asked to consider their evaluations and refusal responses in RIs. The results showed that CLKs were more likely to reject native Korean pragmatic norms, and their choices were influenced by four major factors such as their personalities, multilingual identities, their ongoing life histories, and relationship affordances. These findings have pedagogical implications for L2 Korean assessment.
First, the MQ data were analyzed to identify the participants' rational choices. The data was categorized according Ishihara (2010)'s definition of pragmatic resistance. Then, we compared their choices with their linguistic performance using DCTs to determine if they were a sign of a pragmatic resistance. Interviewees were also required to explain why they chose a pragmatic behavior in certain situations.
The results of the MQs, DCTs and z-tests were examined using descriptive statistics and z tests. The CLKs were discovered to use euphemistic words like "sorry" or "thank you". This is likely due to their lack experience with the target languages, which led to an inadequate understanding of the korean pragmatic norms. The results revealed that CLKs' preferences to differ from L1 and L2 norms or to be more convergent towards L1 norms varied based on the DCT situations. In Situations 3 and 12, CLKs preferred diverging from both L1pragmatic norms and L2 norms, while in Situation 14, CLKs preferred convergence to L1 norms.
The RIs revealed that CLKs were aware of their logical resistance to every DCT situation. The RIs were conducted one-toone within two days after participants completed the MQs. The RIs were recorded and transcribed, then coded by two coders who were independent. The code was re-coded repeatedly by the coders, re-reading and discussing each transcript. The results of coding were evaluated against the original RI transcripts, giving an indication of how well the RIs captured the underlying pragmatic behaviors.

Refusal Interviews (RIs)
The most important problem in the field of pragmatic research is: Why do certain learners decide to not accept native-speaker norms? Recent research attempted to answer this question by using a variety of experiments, including DCTs MQs and RIs. Participants comprised 46 CLKs and 44 CNSs from five Korean Universities. They were required to complete the DCTs in their first language and to complete the MQs either in their L1 or L2. They were then invited to an RI, where they were required to reflect on and discuss their responses to each DCT situation.
The results showed that on average, the CLKs resisted native-speaker pragmatic norms in over 40% of their answers. They did this even though they were able to create patterns that resembled natives. They were also aware of their pragmatic resistance. They attributed their choice to learner-internal factors like their identities and personalities as well as multilingual identities. They also referred to external factors, such as relationships and benefits. For instance, they outlined how their relationships with professors facilitated more relaxed performance with respect to the linguistic and intercultural rules of their university.
However, the interviewees also expressed concern about the social pressures and penalties they could be subjected to if they strayed from their social norms. They were worried that their native friends would think they are "foreigners" and believe that they are not intelligent. This concern was similar to those voiced by Brown (2013) and Ishihara (2009).
These results suggest that native speakers pragmatic norms aren't the norm for Korean learners. They could still be useful for official Korean proficiency tests. But it would be prudent for future researchers to reassess their relevance in specific scenarios and in various contexts. This will allow them to better understand how different cultural environments may impact the pragmatic behavior of L2 students in the classroom and beyond. This will also aid educators create better methods for teaching and testing Korean pragmatics. Seukhoon Paul Choi is principal advisor for Stratways Group, a geopolitical risk consulting firm based in Seoul.
Case Studies
The case study method is a research method that employs intensive, participant-centered research to investigate a specific topic. It is a method that makes use of various sources of information to back up the findings, such as interviews, observations, documents, and artifacts. This type of investigation is useful when analyzing complicated or unique subjects that are difficult to quantify using other methods.
In a case study, the first step is to define the subject and the goals of the study. This will allow you to identify what aspects of the subject should be studied and which ones can be skipped. It is also helpful to study the literature that is relevant to the topic to gain a better understanding of the subject and to place the case study within a larger theoretical context.
This study was conducted on an open source platform such as the KMMLU leaderboard [50] and its specific benchmarks for Korea, HyperCLOVA X and LDCC-Solar (figure 1 below). The results of the test revealed that the L2 Korean students were particularly susceptible to native models. They were more likely to choose incorrect answers that were literal interpretations of the prompts, which were not based on accurate pragmatic inference. They also had an inclination to add their own text, or "garbage," to their responses, further detracting from their quality of response.
Additionally, the participants in this case study were primarily L2 Korean learners who had reached level 4 in the Test of Proficiency in Korean (TOPIK) at the end of their second or third year at university and were aiming for level 6 on their next attempt. They were asked questions about their WTC/SPCC, their pragmatic awareness and understanding and their understanding of the world.
Interviewees were presented with two scenarios that involved interaction with their counterparts and asked to choose one of the strategies below to employ when making an offer. They were then asked to explain the reasons behind their decision. Most of the participants attributed their rational opposition to their personalities. For instance, TS claimed that she was difficult to connect to, and so she refused to ask about the health of her interlocutors despite having an intense workload despite the fact that she believed that native Koreans would do so.