Kialo Explained

Kialo is an online structured debate platform with argument maps in the form of debate trees. It is a collaborative reasoning tool for thoughtful discussion, understanding different points of view, and collaborative decision-making, showing arguments for and against claims underneath user-submitted theses or questions.^{[1] [2]}

The deliberative discourse platform is designed to present hundreds of supporting or opposing arguments in a dynamic argument tree^[3] and is streamlined for rational civil debate on topics such as philosophical questions, policy deliberations, entertainment, ethics, science questions, and unsolved problems or subjects of disagreement in general.

Argument-boxes are structured into hierarchical branches where the root is the main thesis (or theses) of the debate, enabling deliberation and navigable debates between opposing perspectives. A debate is divided into Pro (supporting) and Con (refuting or devaluing) columns where registered users can add arguments and rate the of the parent claim. The arguments .

Its argument tree structure enables detailed scrutiny of claims at all levels of the tree and allows users to for example quickly understand why a decision was made or which of the aggregated arguments swayed it this way. Newcomers can join a debate at any time and look back at the structured discussion history, and then weigh in at the right place with their new argument or their comment on a specific argument. The design presets a structure on debates "that allows participants to easily see, process, and ultimately assess the many facets of competing claims".

The word Kialo is Esperanto for "reason".^[4] The platform is the world's largest argument mapping and structured debate site.^[5]

Overview

Users can comment on every Pro or Con, for example for requesting sources or expansions. Recent activities of a debate are shown in a panel on the right side of the respective debate. Debates can be found through the search or on the Explore page through their descriptions and topic-tags.^[2]

Mere comments that do not make a constructive point (a self-contained argument backed by reasoning) are not allowed and are picked up by other users and moderators.^{[4] [2]} "Civil language and sensible observations from opposing perspectives" can be seen also in debates about controversial topics. The site by-design incentivizes fair, rigorous, open-minded dialogue.^[6] Contributors making claims often also write counterpoints to their own contribution.^[4] Claims need to be shorter than 500 characters and can link to external sources.

Debate trees can also start off with multiple theses – such as or hypotheses. Claims can link to related debates or include segments of them. In the discussion tab of each claim, users can make edit proposals (e.g. for accuracy, improving sources, or changing scope), decide if the argument should be moved or copied to another branch, call for archiving a claim, and ask for extra evidence or clarification.

Debates can grow large and complex for which a sunburst diagram ^{[2] [7] [8] [9]} and the search functionality can be useful. Each debate also has a chat-box.^{[10] [11]} In cases where e.g. a "Con" is a point against multiple in the "Pros", users – through moderators – can link these arguments at the respective places to avoid duplication of content and allowing a clean chain for people to understand which points are arguments against each other. Contributions of users are tracked, enabling a board of thought-leaders for every debate.^[12] Other gamification elements include a feature to thank users for their contributions.^[13]

The "Perspectives" feature allows users to see 'Impact' ratings of supporters and opposers of a thesis as well as of the debate's moderators and individual contributors. It thereby enables participants to see a debate from other participants' perspectives and to sort by them. In Kialo Edu, this feature lets teachers view votes for a whole class, individuals, or supporters/opponents of a specific thesis.^[14] Users in both versions of Kialo can vote on the overall debate topic as well as on individual claims to express their perspectives or conclusions, with the rationale (i.e. the main causal arguments) why they voted on the veracity of the thesis as they did not being captured. Voting can be done by any registered user while navigating through any debate that has voting enabled or via using the Guided Voting wizard user interface that automatically walks through branches.^[15]

As of 2021, Kialo doesn't have a mobile app.^[16]

Contents

A 2018 report stated the collaborative argument platform hosts more than 10,000 debates in various languages. It also hosts private debates. The website claims that it has over 18,000 public debates as of July 2023, as well as over 1 million votes and over 720,000 claims.^[17] Debates can be found via the site's internal search and up to six tags per debate.

Preprint studies have scraped public debates on over 1.4K issues with over 130K statements as of October 2019 and 1628 debates, related to over 1120 categories, with 124,312 unique claims as of June 26, 2020.

Kialo Inc.

The site is run by Kialo Inc. It was founded by German-born entrepreneur and London School of Economics and Political Science graduate Errikos Pitsos in August 2017 and is based in Brooklyn and Berlin.^[4] According to a 2018 report, the site does not show advertisements and does not sell user's data.^[4] The for-profit company was founded in 2011,^[18] Pitsos began to develop the concept in 2012^[19] and described various specifics of the system in 2014.^[20] In 2018, he stated that they intend to make money by selling the platform to companies as a deliberation and decision-making tool.^[19] The site is free to use for the public and in education. According to the site, as of 2023 Kialo.com is a non-revenue generating site with no ads and no reselling of user data.^[21]

Applications and adoption

Adopted applications

Applications of its content or the platform in society include:

• Teachers and professors, especially in high schools – including the universities Harvard and Princeton, are using Kialo for class discussions and exercises in critical thinking and reasoning,^{[4] [16] [19] [22] [5]} as consolidating understanding of materials covered in recent classes,^[5] more useful and engaging learning experiences, for remote/e-learning,^[23] for clearing up misconceptions, teaching logical fallacies and rational argumentation,^[24] for academic dialogue,^[25] teaching media literacy, and for teaching to sufficiently reflect or research before posting online.^[26] Like for debaters of the main site, access for schools and universities is free. is the custom version of Kialo specifically designed for classroom use where debates are private and locked to invited students.^{[27] [28] [29] [30] [5] [31]}
  • Kialo allows teachers to provide feedback to students on their ideas, argument structure, and research quality while it is left to other students to rate the impacts of their peers' arguments.^[28]
  • Students can be allowed to contribute anonymously which may be useful for controversial issues as well as for safeguarding privacy in education.^[32]
  • Students are or can be encouraged to back up their claims with evidence which can foster digital literacy and research skills.^[28]
  • Students and teachers can use it to arrange their thoughts when structuring an essay or project.^[28]
• The site's name was decided on internally using the software.

Prototypical and theoretical applications

See also: Evidence-based policy. Potential, theoretical, prototypical or little-used applications include:

Education

• Improving critical thinking skills of society at large as well as facilitating deep or efficient thinking and deepening research and debates^{[7] [28] [22]} where e.g. discussions are less shallow and the well-known or many arguments have already been made and in many cases aren't unreasonably over- or underrated.
  • Pitsos claimed that "we're training students to be very good test-takers instead of critical thinkers", suggesting teaching people to think things through may be more important or neglected compared to essay writing skills.
• Many young people and adults are "submerged into a sea of dispersed information", "[b]rowsing and engaging in superficial thinking activities". Kialo could counteract this issue and help people develop good sane reasoning.^[7]

Academia, R&D and policy

• Three scholars from three prestigious U.S. universities outlined possible benefits in this domain, including applications beyond higher education such as for academic communication. They suggest the debate platform could be used for structuring the communication of open peer-review by helping those giving feedback to "hone in on[sic] core arguments and pieces of evidence in an even more direct way" than annotated commenting.^{[7] [33]}
• It could be used to evaluate extracted argument structures and sequences from raw texts,^[33] as in a Semantic Web for arguments. Such "argument mining", to which Kialo is the largest structured source so far, could e.g. be used to assess the completeness and effectiveness of an argumentative discussion or to augment it (with additional arguments, contextual information, assessments, refuting evidence or supporting data).
• A security studies paper suggested it could be used for "managing arguments more effectively than traditional paragraph/bullet-point approaches". It claims that "complexity demands adaptation" but also notes that "Kialo's simplicity does pose some weaknesses and limitations, and in general current systems cannot reliably automate analysis or synthesis of arguments in the same way that statistical packages can automate analysis of data".^[34]
• The site could be used by companies and government organizations as "intuitive debate software for internal discussions and decision-making".^{[4] [7]}
• It could aid in the search for the best policies and course of action,^[33] including for 'wicked problems' and issues where there is a large polarization. This may include "experiments of deliberative democracy inside local governments".^[19]
• With a platform like Kialo, users provide "both data on what they see is in the landscape of relevant arguments but also some indication of what they think is important [or has [[prioritization|priority]]] in determining their policy preferences" and "also shows which arguments the individual did not find persuasive, and possibly which rebuttals to a particular argument [was] used to discard it."^[33] Current functionality of the site may still be insufficient for the latter outside of experiments.
• It could increase efficiency in knowledge acquisition, including concerning information overload on social media.
• Policy-makers and scientists could use platforms and debates like these to engage with each other as well as the public if they were aware of it and used it. Considering only argument trees beneath theses, its arguments-crowdsourcing and revision principles are not or less vulnerable to framing-issues, intentionally placed attackable segments, weak or missing arguments, straw man points, oversimplification, agenda-setting and other issues that may be common in contemporary public political debates.
• The debate trees can be used to identify arguments that are seen as most credible, as well as reveal which areas of argumentation lack support, precedent, or evidence,^[33] which may be useful for subsequent work or more efficient and useful science (as in identifying little-supported assumptions, providing key missing data, or researching key open questions).

General

• Writers in general, as well as possibly major other opinion leaders, could populate a Kialo debate with their arguments and release it alongside the traditional linear written format,^[33] albeit such would mean the arguments would be open to scrutiny, with such being more accessible than large and fans-dominated unstructured comment sections or may already be part of an existing debate tree. They could also use the site in other ways such as for selecting questions to pose to interviewees or for selecting unexplored questions to investigate and report on.
• It could be used for legal cases.^[33]
• Websites could embed read-only argument trees (or branches) from the site.^[19]
• More broadly, the site's content could be used for reflective brainstorming, and as a crowdsourcing resource for points to use in other media (e.g. long-form text). It enables detailed exploration of some theses or topics as the visual reasoning through tree-based structure allows for many levels of depth and for follow-up questions in the discussion tab of each claim. The founder stated that "The public debates are basically supposed to become a site where people can go and inform themselves. If a debate has over 2,000 unique arguments, it's going to be hard to find an argument that's not in there already. You can go there, similar to Wikipedia, and read."

Research

Kialo is a subject of research studies and its data has been used in research as there are datasets of its contents^[2] and the site allows exporting CSV files^[33] as well as crawling and filtering debates.^[35]

Computational research on argumentationThe platform has gained attention in computational research on argumentation because of its high-quality arguments and elaborate argument trees.^{[36] [37]} Its data has been used to train and to evaluate natural language processing AI systems such as, most commonly, BERT and its variants. This includes argument extraction, conclusion generation, argument assessment, machine argumentative debate generation or participation,^{[35] [37]} surfacing most relevant previously overlooked viewpoints or arguments,^[35] argumentative writing support^[38] (incl. sentence attackability scores), automatic real-time evaluation of how truthful or convincing a sentence is (similar to fact-checking),^[39] language model fine tuning^{[40] [37]} (incl. chatbots),^{[41] [42]} argument impact prediction, argument classification and polarity prediction.^{[43] [44]}

Content analysis in social science and belief studiesThe contents can also be analyzed to e.g. show the most common Con rationale-types and factors in general,^[39] or reveal the most contested arguments where ratings diverge the most for a given topic.

The site's founder proposed the types of arguments and ways people reason could be investigated as well as the "performance of Kialo versus long-form text in making people change their minds". One study suggests arguers seem to change their viewpoints more readily when a fact they believe has evidence and is undermined when compared to prior beliefs without .^[39]

The platform as a subject

A study showed that when evaluating policies via Kialo debates, "reading comments from most to least liked, on average, displays more [winning arguments] than reading comments earliest first".^[45] Kialo has a set of different permissions that participants can have in a given debate. A preprint study makes suggestions regarding "interface design as a scalable solution to conflict management" to prevent adversarial beliefs and values of moderators to have negative impacts on the site.^[46]

Reception, motivation and distinction from alternatives

In 2022, MakeUseOf named the site as one of the five best "debate sites to civilly and logically argue online about opinions" and in 2019 as one of the "100+ best websites on the Internet".^[47]

Online discourse qualityThe site aims to be a hub for civilized debate where shouting, rudeness or irrationality aren't allowed.^{[4] [19]} This has been described as remarkable in an "age of Trumpian tweeting".^[4] The site's founder stated that he noticed early on that the Web became "ideal for bad conversations, with prominence given to the most outrageous conversations" and that he "wondered if there wasn't a better method of online discourse", claiming the site's mission is to "empower reason and to make the world more thoughtful",^{[4] [1] [48] [27]} describing it as a "platform where people with opposing views can meet and understand each other's thinking".^[49] As of 2023, there are major concerns about online irrational or misinformation-fueled debate – for example, a researcher affirmed^[50] that "Twitter was not designed or intended to be a digital town square" as part of a "functioning democracy", addressing Elon Musk's comments about the site in 2022. Instead, she claims it to be a "space for millions of town criers, but not a town square for people to come together and debate".^[51] Reports suggest the site may present a more complete and complex view of reality than some other sites where "it's easy to get trapped in echo-chambers of like-minded people where your beliefs are never [meaningfully] challenged" as it shows you "the best arguments on both sides of a debate".^{[52] [53]}

Communication formats e.g. "tend to only allow a linear progression of arguments in a stream-of-discussion format".^[33] On many websites, "circuitous comment threads [often] render meaningful discussion impossible" and "formats that we use to communicate shape the way we communicate".^[54] On the site, users contribute to a debate tree rather than engaging in argumentative back-and-forth commenting.^[55]

Kialo may be more appropriate especially for discussions that are relatively complex and hard to visualize or oversee otherwise and allows for public ideation and structured interaction among different types of stakeholders.^[53] Linking to supporting evidence is encouraged,^[50] but not as strictly required as for example on Wikipedia. Kialo has advantages over structured knowledge bases and Wikipedia in "that it includes many debatable statements; many attacked sentences are subjective judgments, so fact-based knowledge sources may have limited utility".^[39] Chains of reasoning can be followed "from beginning to end" with relatively little text to read, nearly no repetition or unexplained statements and without having it derailed by for example "name-calling and directionless ranting".^[50] Online debates "have grown so large and acrimonious that no one realistically has the time to read everything and hence get a sense of the actually winning arguments (winners) after all points have been considered" and there is research into how to efficiently calculate the winning arguments or arguments weights and the overall conclusions.^[56] Moreover, argumentations on the site are less fleeting and repetitive than debates on social media sites – they are commonly read and actively contributed to over the span of years.^{[28] [54]}

Criticisms and current limitationsOne preprint study stated that "[t]hough kialo is designed for scale, and therefore has to be not only robust but also both easy and appealing to use, it has simplified its notion of argument structure so much that there is very little flexibility left. As a commercial entity, its data [not reusable] and platform [not [[free and open source software|open source]]] are also closed, making wide-scale application at the science-policy interface more challenging."^[57]

One study found that "Kialo's simplicity does pose some weaknesses and limitations" and found the functionality of current systems including Kialo for "synthesis of arguments" to be insufficient.^[34] One study suggests the platform is structured in a way that gives insufficient capacity for users to do anything else other than to either agree or disagree with a side,^[58] with there e.g. only being options to rate the veracity of the main thesis but not for proposing concrete alternatives and middle-grounds such as more nuanced policies or specifying conditional critical considerations (e.g. exceptions, applicable scopes and limitations) of one's veracity rating of the main thesis, which tend to be very brief and rarely revised.

One study points out that without 'Writer' permissions in a debate, the arguments have "to get past the gatekeepers" of it, which can in some cases be problematic as moderators' beliefs and values may play a role.^[46] For instance, such can lead to some users feeling like certain perspectives (or arguments) are being excluded from a debate^[46] or getting positioned inappropriately (such as not being visible at the level most relevant). There may be issues relating to framing and argument positioning, whereby for example a false claim (with or without a source) can be added as supporting a thesis which is then only addressed by a later countering claim stating the opposite beneath it – which may reduce the former's 'Impact' rating but is not shown directly at the tree level above as an 'countering' argument. Instead, only the false or weak supporting argument can be seen at the level above in such a case. Impact rating votes do not require reading the arguments beneath but voting can be turned off until the argument map has had time to sufficiently develop.^[59]

ComplementarityThe founder clarified key distinctions and complementarity of the site saying "We're going to just be an added place. We're not competing with anybody out there with regards to thoughtful discourse. There are a couple of sites that are question-and-answer sites, or commenting sites, or sharing sites, but there's not a single [major] site for collaborative reasoning — a repository of the why".^[54] He states that Wikipedia – another peer production site to which Kialo is sometimes compared with due to argumentative discussions on Talk pages^[36] and its public collaborative knowledge integration^[46] – "tells you the what and we tell you the why".^[54]

See also

• • • • Evidence-based practices – potential uses
• Public awareness of science – platform use can expose people to most relevant counterarguments and data
• Internet manipulation#Countermeasures – related risks
• Knowledge integration – argument integration
• List of logical fallacies – potential way to classify arguments or removals
• Socratic method – related educational concept
• The medium is the message – importance of platform structure-design
• Causal inference – related to identification of data needs
• r/changemyview – an unstructured debate website
• Project Debater – an AI system

External links

• Kialo Edu blog, guides and ideas for applications in education
  • Structured online debate and conclusion-making, images and related projects
• The Role of Pragmatic and Discourse Context in Determining Argument Impact, 2019, R&D on determining argument impact

Notes and References

1. Web site: About . Kialo . 9 June 2023 . en . 7 June 2023 . https://web.archive.org/web/20230607192456/https://www.kialo.com/about . live .
2. Book: Agarwal . Vibhor . Joglekar . Sagar . Young . Anthony P. . Sastry . Nishanth . Proceedings of the ACM Web Conference 2022 . GraphNLI: A Graph-based Natural Language Inference Model for Polarity Prediction in Online Debates . 25 April 2022 . 2729–2737 . 10.1145/3485447.3512144. 2202.08175 . 9781450390965 . 246867079 .
3. Book: Development Co-operation Report 2021 Shaping a Just Digital Transformation: Shaping a Just Digital Transformation . 21 December 2021 . OECD Publishing . 978-92-64-85686-8 . 327 . en . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611175141/https://books.google.com/books?id=ARtZEAAAQBAJ . live .
4. News: Margolis . Jonathan . Meet the start-up that wants to sell you civilised debate . 9 June 2023 . . 24 January 2018 . 11 June 2023 . https://web.archive.org/web/20230611174157/https://www.ft.com/content/4c19005c-ff5f-11e7-9e12-af73e8db3c71 . live .
5. Ovidiu . Acomi . Nicoleta . Acomi . Roxana . Andrei Elena . Francesca . Dadomo . Domitille . Hocq . Luis . Ochoa Siguencia . Renata . Ochoa-Daderska . Fabiola . Porcelli . Savino . Ricchiuto . Ana . Velasco Garcia . Empowering Youth to Critically Analyse Fake News. Strategies of Intervention and Good Practices. . 10.5281/zenodo.6549573 . 15 May 2022 . 11 June 2023 . 21 July 2023 . https://web.archive.org/web/20230721233306/https://zenodo.org/record/6549573 . live .
6. Book: Alfano . Mark . Klein . Colin . Ridder . Jeroen de . Social Virtue Epistemology . 29 July 2022 . Taylor & Francis . 978-1-000-60730-7 . 43 . en . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611175136/https://books.google.com/books?id=L1J-EAAAQBAJ . live .
7. Web site: Developing critical thinking skills with Kialo – Library Trends . TU Delft . 9 June 2023 . 16 January 2018 . 11 June 2023 . https://web.archive.org/web/20230611174156/https://trends.tudl.tudelft.nl/2018/01/16/developing-critical-thinking-skills-with-kialo/ . live .
8. Book: Anastasiou . Lucas . De Liddo . Anna . Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems . Making Sense of Online Discussions: Can Automated Reports help? . 8 May 2021 . 1–7 . 10.1145/3411763.3451815 . Association for Computing Machinery. 9781450380959 . 233987842 .
9. Book: Kiesel . Johannes . Spina . Damiano . Wachsmuth . Henning . Stein . Benno . CUI 2021 - 3rd Conference on Conversational User Interfaces . The Meant, the Said, and the Understood: Conversational Argument Search and Cognitive Biases . 27 July 2021 . 1–5 . 10.1145/3469595.3469615 . Association for Computing Machinery. 9781450389983 . 236203094 .
10. A Blended Approach to Flipped Learning for Teaching Debate – Using Kialo Edu for EFL Debate Preparation. Heather . Woodward. Laura. Padfield. Journal of Multilingual Pedagogy and Practice . 2021 . 1 . 10.14992/00020487.
11. Web site: Taking it to Task Volume 5, Issue 1, Summer 2021 . 10 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174157/https://www.tblsig.org/wp-content/uploads/2021/09/2021-Summer-Taking-it-to-Task.pdf . live .
12. Web site: Statistics and the Infographic Kialo Edu Help Center . support.kialo-edu.com . 10 June 2023 . 5 August 2022 . 11 June 2023 . https://web.archive.org/web/20230611174157/https://support.kialo-edu.com/en/hc/statistics-and-the-infographic/ . live .
13. Web site: Feger . Marc . Online argumentation and social media: What they can learn from each other . 11 June 2023 . May 2021.
14. Web site: Teaching students to take different perspectives with Kialo Edu . 9 June 2023 . 17 May 2023 . 11 June 2023 . https://web.archive.org/web/20230611174159/https://blog.kialo-edu.com/tips-and-tricks/teaching-students-to-take-different-perspectives-on-kialo-edu/ . live .
15. Web site: Guided Voting Kialo Help Center . support.kialo.com . 18 July 2023 . 4 June 2023 . https://web.archive.org/web/20230604164528/https://support.kialo.com/en/hc/guided-voting/ . live .
16. Web site: Debating the Issues with Kialo ETEC523: Mobile and Open Learning . blogs.ubc.ca . . 9 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174156/https://blogs.ubc.ca/etec523/2021/02/07/debating-the-issues-with-kialo/ . live .
17. Web site: Explore Popular Debates, Discussions and Critical Thinking… . Kialo . 16 July 2023 . en. https://web.archive.org/web/20230718113255/https://www.kialo.com/. 18 July 2023.
18. Web site: Kialo - Products, Competitors, Financials, Employees, Headquarters Locations . . 9 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174156/https://www.cbinsights.com/company/kialo . live .
19. Web site: Four News Startups Trying To Improve Civic Discourse . Nieman Reports . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174205/https://niemanreports.org/articles/four-news-startups-trying-to-improve-civic-discourse/ . live .
20. Web site: US Patent Application for Management, Evaluation And Visualization Method, System And User Interface For Discussions And Assertions Patent Application (Application #20150220580 issued August 6, 2015) - Justia Patents Search . patents.justia.com . 9 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174155/https://patents.justia.com/patent/20150220580 . live .
21. Web site: Terms of Service Kialo . www.kialo.com . 18 July 2023 . 2 July 2023 . https://web.archive.org/web/20230702114845/https://www.kialo.com/terms . live .
22. Web site: Mahoney . Jon . Drawing the Line: Integrating Kialo to Deepen Critical Thinking in Debate . 2023-06-11 . 2023-06-11 . https://web.archive.org/web/20230611174156/https://rikkyo.repo.nii.ac.jp/?action=repository_action_common_download&item_id=22525&item_no=1&attribute_id=22&file_no=1 . live .
23. Mishra . Lokanath . Gupta . Tushar . Shree . Abha . Online teaching-learning in higher education during lockdown period of COVID-19 pandemic . International Journal of Educational Research Open . 2020 . 1 . 100012 . 10.1016/j.ijedro.2020.100012. 35059663 . 7832355 .
24. Book: Wasson . Barbara . Zörgő . Szilvia . Advances in Quantitative Ethnography: Third International Conference, ICQE 2021, Virtual Event, November 6–11, 2021, Proceedings . 11 January 2022 . Springer Nature . 978-3-030-93859-8 . 34 . en . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611175136/https://books.google.com/books?id=wdFYEAAAQBAJ . live .
25. Book: Blackburn . Barbara R. . Rigor in the Remote Learning Classroom: Instructional Tips and Strategies . 16 September 2020 . Routledge . 978-1-000-24635-3 . en . Demonstrating Learning in the Remote Classroom . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611175137/https://books.google.com/books?id=rYH4DwAAQBAJ . live .
26. Book: Schiebenes . Pascal . Digitale Medien für den Unterricht: Deutsch: 30 innovative Unterrichtsideen . 1 November 2022 . Klett / Kallmeyer . 978-3-617-92409-9 . 54 . de . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611175136/https://books.google.com/books?id=6NGZEAAAQBAJ . live .
27. Book: Mills . Afrika Afeni . Open Windows, Open Minds: Developing Antiracist, Pro-Human Students . 16 June 2022 . Corwin Press . 978-1-0718-8702-8 . en . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611175140/https://books.google.com/books?id=cL9pEAAAQBAJ&pg=PT231 . live .
28. Web site: Edwards . Luke . What is Kialo? Best Tips and Tricks . TechLearningMagazine . 9 June 2023 . en . 7 July 2021 . 11 June 2023 . https://web.archive.org/web/20230611174155/https://www.techlearning.com/how-to/what-is-kialo-best-tips-and-tricks . live .
29. Web site: Butcher . Charity . Creating Online Debates Using Kialo Edu . 9 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174159/https://educate.apsanet.org/wp-content/uploads/Creating-Online-Debates-Using-Kialo-Edu.pdf . live .
30. Book: Lang-Raad . Nathan D. . Never Stop Asking: Teaching Students to be Better Critical Thinkers . 18 April 2023 . John Wiley & Sons . 978-1-119-88754-6 . 114 . en . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611175138/https://books.google.com/books?id=-7OvEAAAQBAJ . live .
31. Web site: Try Out a Kialo Classroom Debate for High School Kialo Edu Help Center . support.kialo-edu.com . 9 June 2023 . 5 August 2022 . 11 June 2023 . https://web.archive.org/web/20230611174155/https://support.kialo-edu.com/en/hc/try-out-a-kialo-classroom-debate-for-high-school/ . live .
32. Web site: How students can benefit from Anonymous Discussions . 9 June 2023 . 8 May 2023 . 11 June 2023 . https://web.archive.org/web/20230611174155/https://blog.kialo-edu.com/teaching-strategies/how-students-benefit-from-anonymous-discussions/ . live .
33. Web site: Chaudoin . Stephen . Shapiro . Jacob . Tingley . Dustin . Revolutionizing Teaching and Research with a Structured Debate Platform . scholar.harvard.edu . August 2017 . 2023-06-11 . 2023-06-11 . https://web.archive.org/web/20230611174154/https://scholar.harvard.edu/sites/scholar.harvard.edu/files/dtingley/files/structureddebate.pdf . live .
34. Complexity Demands Adaptation: Two Proposals for Facilitating Better Debate in International Relations and Conflict Research . Georgetown Security Studies Review . 30 November 2022 . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174156/https://georgetownsecuritystudiesreview.org/2022/11/30/complexity-demands-adaptation-two-proposals-for-facilitating-better-debate-in-international-relations-and-conflict-research/ . live .
35. High Quality Real-Time Structured Debate Generation . 2012.00209 . Bolton . Eric . Calderwood . Alex . Christensen . Niles . Kafrouni . Jerome . Drori . Iddo . 2020 . cs.CL .
36. Guo . Zhen . Singh . Munindar P. . Representing and Determining Argumentative Relevance in Online Discussions: A General Approach . Proceedings of the International AAAI Conference on Web and Social Media . 2 June 2023 . 17 . 292–302 . 10.1609/icwsm.v17i1.22146 . 259427857 . en . 2334-0770 . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174155/https://ojs.aaai.org/index.php/ICWSM/article/view/22146 . live . free .
37. Book: Al Khatib . Khalid . Trautner . Lukas . Wachsmuth . Henning . Hou . Yufang . Stein . Benno . Employing Argumentation Knowledge Graphs for Neural Argument Generation . Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) . August 2021 . 4744–4754 . 10.18653/v1/2021.acl-long.366 . https://aclanthology.org/2021.acl-long.366.pdf . Association for Computational Linguistics . 236460348 . 2023-06-11 . 2023-04-08 . https://web.archive.org/web/20230408122138/https://aclanthology.org/2021.acl-long.366.pdf . live .
38. To Revise or Not to Revise: Learning to Detect Improvable Claims for Argumentative Writing Support . 2305.16799 . Skitalinskaya . Gabriella . Wachsmuth . Henning . 2023 . cs.CL .
39. Detecting Attackable Sentences in Arguments . 2010.02660 . Jo . Yohan . Bang . Seojin . Manzoor . Emaad . Hovy . Eduard . Reed . Chris . 2020 . cs.CL .
40. Book: Fanton . Margherita . Bonaldi . Helena . Tekiroglu . Serra Sinem . Guerini . Marco . Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) . Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speech . 3226–3240 . 10.18653/v1/2021.acl-long.250 . 2021. 2107.08720 . 236087808 .
41. Björklin . Hampus . Abrahamsson . Tim . Widenfalk . Oscar . A retrieval-based chatbot's opinion on the trolley problem . 2021 . 2023-06-11 . 2023-06-11 . https://web.archive.org/web/20230611174159/https://www.diva-portal.org/smash/record.jsf?pid=diva2:1571401 . live .
42. Opening up Minds with Argumentative Dialogues . 2301.06400 . Farag . Youmna . Brand . Charlotte O. . Amidei . Jacopo . Piwek . Paul . Stafford . Tom . Stoyanchev . Svetlana . Vlachos . Andreas . 2023 . cs.CL .
43. Agarwal . Vibhor . P. Young . Anthony . Joglekar . Sagar . Sastry . Nishanth . A Graph-Based Context-Aware Model to Understand Online Conversations . ACM Transactions on the Web . 2024 . 18 . 1–27 . 10.1145/3624579 . 2211.09207 .
44. Towards an Argument Mining Pipeline Transforming Texts to Argument Graphs . 10.3233/FAIA200510 . 2006.04562 . Lenz . Mirko . Sahitaj . Premtim . Kallenberg . Sean . Coors . Christopher . Dumani . Lorik . Schenkel . Ralf . Bergmann . Ralph . 2020 . 263–270 . IOS Press . 219531343 .
45. Young . Anthony P. . Joglekar . Sagar . Boschi . Gioia . Sastry . Nishanth . Ranking comment sorting policies in online debates . Argument & Computation . 1 January 2021 . 12 . 2 . 265–285 . 10.3233/AAC-200909 . 228956951 . en . 1946-2166. free .
46. Managing Conflict in Online Debate Communities: Foregrounding Moderators' Beliefs and Values on Kialo . 10.31219/osf.io/cdfq7 . Beck . Jordan . Neupane . Bikalpa . Carroll . John M. . 239864855 . 2023-06-11 .
47. Web site: The 100+ Best Websites on the Internet . MUO . 9 June 2023 . en . 30 November 2019 . 11 June 2023 . https://web.archive.org/web/20230611174155/https://www.makeuseof.com/tag/best-websites-internet/ . live .
48. Book: Killenberg . G. Michael . Anderson . Rob . Democracy's News: A Primer on Journalism for Citizens Who Care about Democracy . 20 February 2023 . University of Michigan Press . 978-0-472-05584-5 . 383 . en . 11 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611175132/https://books.google.com/books?id=f86kEAAAQBAJ&pg=PA383 . live .
49. Web site: xpmethod Group for experimental methods in the humanities . xpmethod.columbia.edu . 9 June 2023 . 2023-06-11 . https://web.archive.org/web/20230611174159/https://xpmethod.columbia.edu/events/2016-11-08-kialo.html . live .
50. News: Kialo offers online debate where nobody shouts . 9 June 2023 . The Irish Times . en . 11 June 2023 . https://web.archive.org/web/20230611174155/https://www.irishtimes.com/business/technology/kialo-offers-online-debate-where-nobody-shouts-1.3375020 . live .
51. News: Maddox . Jessica . Elon Musk's comments about Twitter don't square with the social media platform's reality . 25 September 2022 . techxplore.com . en . 25 September 2022 . https://web.archive.org/web/20220925223732/https://techxplore.com/news/2022-05-elon-musk-comments-twitter-dont.html . live .
52. Web site: 10 Websites That Will Give You Superpowers . Inc.com . 9 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174159/https://www.inc.com/jessica-stillman/10-websites-that-will-give-you-superpowers.html . live .
53. Web site: Debating Solar Geoengineering on the Kialo Visual Reasoning Platform . geoengineering.environment.harvard.edu . 9 June 2023 . en . 25 September 2018 . 11 June 2023 . https://web.archive.org/web/20230611174208/https://geoengineering.environment.harvard.edu/blog/debating-solar-geoengineering-kialo-visual-reasoning-platform . live .
54. News: How to Promote Enlightened Debate Online . 9 June 2023 . . 25 March 2018 . Audrey Williams . June . en . 11 June 2023 . https://web.archive.org/web/20230611174154/https://www.chronicle.com/article/how-to-promote-enlightened-debate-online/ . live .
55. Web site: Debate as pedagogy: Practices, tools, and examples from Harvard faculty – Harvard Initiative for Learning and Teaching (HILT) . hilt.harvard.edu . 16 July 2023 . Kialo, where students make “claims” about a thesis, contributing to a visual debate tree that empowers reason rather than argumentative commenting . 29 May 2023 . https://web.archive.org/web/20230529030452/https://hilt.harvard.edu/news-and-events/events/debate-as-pedagogy-practices-tools-and-examples-from-harvard-faculty/ . live .
56. Web site: Young . Anthony P. . Likes as Argument Strength for Online Debate . 10 June 2023 . 11 June 2023 . https://web.archive.org/web/20230611174159/https://argstrength2021.argumentationcompetition.org/papers/ArgStrength2021_paper_8.pdf . live .
57. Managing Expert Disagreement for the Policy Process and Beyond . 2212.14714 . Hahn . Ulrike . Jens Koed Madsen . Reed . Chris . 2022 . cs.CY .
58. Book: Althuniyan . Najla . Sirrianni . Joseph W. . Rahman . Md Mahfuzer . Liu . Xiaoqing "Frank" . Design of Mobile Service of Intelligent Large-Scale Cyber Argumentation for Analysis and Prediction of Collective Opinions . Artificial Intelligence and Mobile Services – AIMS 2019 . Lecture Notes in Computer Science . 2019 . 11516 . 135–149 . 10.1007/978-3-030-23367-9_10 . Springer International Publishing . 978-3-030-23366-2 . 195353310 . en.
59. Web site: Using Voting Kialo Help Center . support.kialo.com . 18 July 2023 . 4 June 2023 . https://web.archive.org/web/20230604170229/https://support.kialo.com/en/hc/using-voting/ . live .