Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
| project:diplomatic_documents_and_swiss_newspapers_in_1914 [2015/02/28 16:23] – [Documentation] attereb | project:diplomatic_documents_and_swiss_newspapers_in_1914 [2015/03/01 15:46] (current) – [Team] giovanni | ||
|---|---|---|---|
| Line 12: | Line 12: | ||
| * [[https:// | * [[https:// | ||
| * [[https:// | * [[https:// | ||
| - | |||
| ===== Documentation ===== | ===== Documentation ===== | ||
| Line 19: | Line 18: | ||
| In this context, at first we cleaned the data, for example by removing noise caused by short strings of characters and stopwords. The cleansing is a necessary step to reduce noise in the corpus. We then compared prepared tfidf vectors of words and LSI topics and represented each article in the corpus as such. Finally, we indexed the whole corpus of Le Temps to prepare it for similarity queries. THe last step was to build an interface to search the corpus by entering a text (e.g., a Dodis summary). | In this context, at first we cleaned the data, for example by removing noise caused by short strings of characters and stopwords. The cleansing is a necessary step to reduce noise in the corpus. We then compared prepared tfidf vectors of words and LSI topics and represented each article in the corpus as such. Finally, we indexed the whole corpus of Le Temps to prepare it for similarity queries. THe last step was to build an interface to search the corpus by entering a text (e.g., a Dodis summary). | ||
| - | Difficulties were not only technical. For example, the data are massive: we started doing this work on fifteen days, then on three months. Moreover, some Dodis documents were classified (i.e. non public) at the time, therefore some of the decisions don't appear in the newspapers articles. We also used the [[http:// | + | Difficulties were not only technical. For example, the data are massive: we started doing this work on fifteen days, then on three months. Moreover, some Dodis documents were classified (i.e. non public) at the time, therefore some of the decisions don't appear in the newspapers articles. We also used the [[http:// |
| + | |||
| + | ===== Dodis Map ===== | ||
| + | |||
| + | {{: | ||
| + | |||
| + | |||
| + | * [[http:// | ||
| + | * [[https:// | ||
| + | |||
| ===== Team ===== | ===== Team ===== | ||
| Line 27: | Line 36: | ||
| * [[http:// | * [[http:// | ||
| * [[http:// | * [[http:// | ||
| - | * [[user:yrochat|Yannick Rochat]] | + | * [[http:// |
| + | {{tag> glam}} | ||