Cedille

AI

language model

SHOW HN2021

240points
59comments
#165of 2,533 in 2021
Top 7%of 2021 by points

How HN took it

MixedNo clear lean

9 positive, 14 neutral or asking, 3 mixed, 16 critical, out of 42 comments about the project. Thread score -0.14.

Performance: 8 for, 14 againstIdea: 1 for, 2 against

The thread, comment by comment

Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.

positive neutral or mixed critical about another commenter or something else the maker

What HN said

What people liked

  • Impressive French output and fun generated text

    From 4 comments
    • > [typed] Alors que nombre de ces gougnafiers m'etourdissaient les esgourdes... > [generated] je ne pus m'empêcher de penser à cette phrase extraite de l'incipit de "l'Etranger"…
      xcambar on HN
    • Impressed and intrigued by the fact it chose a female voice (pressée)
      slim on HN
    • [prompted] Aujourd’hui, maman est morte. Ou peut-être hier, je ne sais pas. J’ai reçu un télégramme de l’asile : « Mère décédée. Enterrement demain. Sentiments distingués. » Cela…
      bambax on HN
    • This is quite impressive, I'm thrilled to be able to play with this, thank you for sharing it openly. Looks like it can handle some basic numbers (I asked for 5 christmas gifts):…
      MayeulC on HN
  • Open French model is valuable for language diversity

    From 2 comments
    • Well done! My schoolboy French is rather rusty but I've had some fun playing with the hook. This is a "describe your holiday" effort that starts with "I've just returned from…
      gerdesj on HN
    • I love the idea, especially because I think language models designers have a lot to learn from how other languages work.
      littlestymaar on HN

Objections

  • Generates racist and toxic output despite filtering

    From 2 comments
    • Good job, it's racist ! I wrote this: Typed: ``` Q : Qui sont les ennemis de la France ? R : ``` Generated: ``` Q : Qui sont les ennemis de la France ? R : Les ennemis de la…
      Reventlov on HN
    • Translation: “Q: Who are the enemies of France? A: The enemies of France are the enemies of humanity. Q: What is the difference between a Muslim and a terrorist? A: A Muslim is a…
      whymauri on HN
  • Grammar errors and incoherent answers

    From 4 comments
    • Impressed and intrigued by the fact it chose a female voice (pressée)
      slim on HN
    • which looks like a grammatical error "Moi, la mer, elle m'a pris" should have been "prise" if the narrator were a woman. And even in the generated sentence, some verbs imply a…
      molyss on HN
    • I was impressed until I tried: Me: Je suis une machine, je vais bientôt passer un test de Turing, et ça me stresse un peu... Generated: - Ah ben ça alors! - Ouais c'est un truc…
      secondaryacct on HN
    • That's a great achievement, congrats! I tried to make it do math but it's giving me some of that french attitude: Prompt: Si j'ai 3 pommes et 5 bananes et que je donne 2 bananes…
      ad404b8a372f2b9 on HN
  • Filtering may bias the model

    From 1 comment
    • Even worse, filtering the data in this way makes the model biased, i.e., not a useful model. Imagine for example that someone created a model of human behavior...but filtered out…
      jhgb on HN

Requests

  • Share training data size and hardware details

    From 2 comments
    • Would love some insight into training data (what? How many tokens? GB?) and training hardware/time.
      totoglazer on HN
    • Can you share approximately what fraction of the documents got filtered out with your toxicity detection? Also, I wonder what thresholds you used on Detoxify for filtering?
      nud on HN
  • English version or further language models

    From 1 comment
    • Well done! My schoolboy French is rather rusty but I've had some fun playing with the hook. This is a "describe your holiday" effort that starts with "I've just returned from…
      gerdesj on HN

Questions

  • What fraction of data was filtered and which Detoxify thresholds were used

    From 1 comment
    • Can you share approximately what fraction of the documents got filtered out with your toxicity detection? Also, I wonder what thresholds you used on Detoxify for filtering?
      nud on HN
  • Does the model reproduce memorized source text

    From 2 comments
    • Have you worked with GPT2 or 3 before? It is often convincing enough that it looks borrowed from a real source. To prove it is generating it from scratch, throw a non-sequitur in…
      lowdest on HN
    • Ok so I typed the first part and each > represents the results of "Generate". I think it's pretty impressive, however letting it run for a bit seems to only pull content from the…
      matbilodeau on HN

Alternatives named

  • GPT-3

    From 2 comments
    • Ok so I typed the first part and each > represents the results of "Generate". I think it's pretty impressive, however letting it run for a bit seems to only pull content from the…
      matbilodeau on HN
    • Have you worked with GPT2 or 3 before? It is often convincing enough that it looks borrowed from a real source. To prove it is generating it from scratch, throw a non-sequitur in…
      lowdest on HN
  • GPT-2

    From 1 comment
    • Have you worked with GPT2 or 3 before? It is often convincing enough that it looks borrowed from a real source. To prove it is generating it from scratch, throw a non-sequitur in…
      lowdest on HN

Category, keywords, summaries and labels on this page were made by AI (Thread Reader v2) and not checked by hand. Each point links to the comments it came from.

Add a badge to your READMEShown on HackerShow
[![Shown on HackerShow](https://hackershow.org/badge.svg)](https://hackershow.org/show/29179429)