SCM

SCM Repository

[tm] Annotation of /pkg/ChangeLog
ViewVC logotype

Annotation of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log


Revision 755 - (view) (download)
Original Path: trunk/tm/ChangeLog

1 : feinerer 755 2007-06-03 Ingo Feinerer <h0125130@wu-wien.ac.at>
2 :    
3 :     * R/textdoccol.R (replaceWords): Added method to replace a set of
4 :     words by a single word. Useful for synonyms.
5 :    
6 : feinerer 754 2007-05-22 Ingo Feinerer <h0125130@wu-wien.ac.at>
7 :    
8 :     * man/TermDocMatrix.Rd: Fixed documentation on Data slot.
9 :    
10 : feinerer 752 2007-05-19 Ingo Feinerer <h0125130@wu-wien.ac.at>
11 :    
12 :     * R/termdocmatrix.R (textvector): Small fix for dealing with empty
13 :     vectors. Thanks to Ariel Maguyon for his error report.
14 :     (removeSparseTerms): New function to remove columns from a
15 :     term-document matrix exceeding a sparse factor.
16 :    
17 : feinerer 751 2007-05-15 Ingo Feinerer <h0125130@wu-wien.ac.at>
18 :    
19 :     * man/tmUpdate.Rd: Corrected documentation on readerControl parameter.
20 :    
21 : feinerer 750 2007-05-11 Ingo Feinerer <h0125130@wu-wien.ac.at>
22 :    
23 :     * man/sFilter.Rd: Corrected documentation on statement format (use
24 :     '==' instead of '=').
25 :    
26 : feinerer 749 2007-05-08 Ingo Feinerer <h0125130@wu-wien.ac.at>
27 :    
28 :     * R/aobjects.R (StructuredTextDocument): Inherits from
29 :     TextDocument.
30 :    
31 : feinerer 748 2007-05-04 Ingo Feinerer <h0125130@wu-wien.ac.at>
32 :    
33 :     * R/termdocmatrix.R (findFreqTerms): Perform efficient computation
34 :     on sparse matrices as proposed by Martin Maechler.
35 :    
36 : feinerer 747 2007-04-27 Ingo Feinerer <h0125130@wu-wien.ac.at>
37 :    
38 :     * R/textdoccol.R: Removed \code{dbDisconnect} calls since last
39 :     \pkg{filehash} version makes them deprecated.
40 :    
41 : feinerer 744 2007-04-22 Ingo Feinerer <h0125130@wu-wien.ac.at>
42 :    
43 :     * R/termdocmatrix.R (textvector): Stemming is now performed before
44 :     erasing stopwords.
45 :     (weightMatrix): Adapted to handle sparse matrices.
46 :     (TermDocMatrix): Sparse matrix is now efficiently built by
47 :     direct stepwise insertion of row values into it.
48 :    
49 : feinerer 741 2007-04-21 Ingo Feinerer <h0125130@wu-wien.ac.at>
50 :    
51 :     * DESCRIPTION: Replaced \pkg{filehashSQLite} with \pkg{filehash}
52 :     due to ongoing problems. For our purposes the latter is as useful
53 :     as the replaced package.
54 :    
55 : feinerer 738 2007-04-20 Ingo Feinerer <h0125130@wu-wien.ac.at>
56 :    
57 :     * man/TextDocCol.Rd: Replaced \code{readPlain} with \code{object@DefaultReader}.
58 :    
59 :     * man/TermDocMatrix.Rd: Remove deprecated \code{language} argument.
60 :    
61 : feinerer 737 2007-04-15 Ingo Feinerer <h0125130@wu-wien.ac.at>
62 :    
63 :     * R/resolve.R (resolveISOCode): Added ISO 639-1 codes for
64 :     languages with available stopwords.
65 :    
66 : feinerer 736 2007-04-14 Ingo Feinerer <h0125130@wu-wien.ac.at>
67 :    
68 :     * inst/doc/tm.Rnw: Minor corrections in the vignette.
69 :    
70 : feinerer 731 2007-04-11 Ingo Feinerer <h0125130@wu-wien.ac.at>
71 :    
72 : feinerer 732 * DESCRIPTION: Update to version 0.2, since a lot of new features
73 :     have been integrated.
74 : feinerer 731
75 : feinerer 732 * inst/stopwords: Updated existing stopwords and added stopwords
76 :     for various other languages.
77 :    
78 : feinerer 729 2007-04-10 Ingo Feinerer <h0125130@wu-wien.ac.at>
79 :    
80 : feinerer 730 * man/: Updated documentation.
81 :    
82 : feinerer 729 * Work/testDb.R: Script to test database stuff.
83 :    
84 :     * R/: Fixed various database related bugs. Seems to be rather
85 :     useable now, i.e., consider as alpha status for now.
86 :    
87 : feinerer 727 2007-04-08 Ingo Feinerer <h0125130@wu-wien.ac.at>
88 :    
89 :     * R/: Fixed some bugs related to database support.
90 :    
91 : feinerer 726 2007-04-07 Ingo Feinerer <h0125130@wu-wien.ac.at>
92 :    
93 :     * man/: Added a lot of examples to the manuals.
94 :    
95 : feinerer 725 2007-04-05 Ingo Feinerer <h0125130@wu-wien.ac.at>
96 :    
97 :     * man/: Updated parts of the documentation.
98 :    
99 :     * R/textdoccol.R (asPlain): Added conversion from newsgroup
100 :     documents to plain text documents.
101 :    
102 : feinerer 722 2007-04-01 Ingo Feinerer <h0125130@wu-wien.ac.at>
103 :    
104 : feinerer 724 * R/textdoccol.R: Finished experimental database support. Not yet
105 :     intensively tested.
106 :    
107 : feinerer 723 * R/source.R: Now each source has a default reader.
108 :    
109 : feinerer 722 * R/reader.R: \code{FunctionGenerator} is now an attribute, not a
110 :     class anymore.
111 :    
112 :     * R/plaintextdoc.R: Custom show method for plain text documents.
113 :    
114 :     * R/aobjects.R: Added a class for structured text documents.
115 :    
116 :     * R/reader.R: Replaced remaining \code{parser} occurrences with
117 :     \code{reader}.
118 :    
119 :     * R/textdoccol.R (summary): Indent tags.
120 :    
121 : feinerer 725 * R/textdoccol.R (removePunctuation): Transform method to remove
122 : feinerer 722 punctuation marks.
123 :    
124 : feinerer 721 2007-03-21 Ingo Feinerer <h0125130@wu-wien.ac.at>
125 :    
126 :     * R/textdoccol.R (sFilter): Simplified sFilter significantly by
127 :     using prescindMeta().
128 :    
129 : feinerer 719 2007-03-18 Ingo Feinerer <h0125130@wu-wien.ac.at>
130 :    
131 :     * R/textdoccol.R: Improved database support.
132 :    
133 : feinerer 717 2007-03-16 Ingo Feinerer <h0125130@wu-wien.ac.at>
134 :    
135 : feinerer 718 * R/termdocmatrix.R (TermDocMatrix): Uses sparse matrices.
136 :    
137 : feinerer 717 * R/resolve.R (resolveISOcode): Extracts the language from a ISO
138 :     language code.
139 :    
140 :     * R/textdoccol.R (TextDocCol): Refactored several parser arguments
141 :     into parserControl argument.
142 :    
143 :     * R/aobjects.R (TextDocument): Introduced the "Language" slot.
144 :    
145 : feinerer 713 2007-03-14 Ingo Feinerer <h0125130@wu-wien.ac.at>
146 :    
147 : feinerer 715 * Work/tmDataSetup.R: The datasets acq and crude can now be
148 :     created on the fly.
149 :    
150 : feinerer 713 * R/stopwords.R: Introduced a function returning the stopwords for
151 :     a given language (English, German and French at the moment)
152 :    
153 :     * R/textdoccol.R (stemDoc): Stemming uses Rstem if available,
154 :     otherwise falls back to Snowball package.
155 :    
156 : feinerer 711 2007-01-30 Ingo Feinerer <h0125130@wu-wien.ac.at>
157 :    
158 :     * man/dissimilarity-methods.Rd: Make clear that any method offered
159 :     by "dists" from package "cba" can be used.
160 :    
161 : feinerer 708 2007-01-22 Ingo Feinerer <h0125130@wu-wien.ac.at>
162 :    
163 : feinerer 710 * inst/doc/tm.Rnw: Fixed quotes-appearing-as-boxes-bug according
164 :     to Kurt's latex suggestion. Removed points and underscores in
165 :     variable names for consistent naming.
166 :    
167 : feinerer 708 * DESCRIPTION: Update to version 0.1-2.
168 :    
169 :     * man/TextRepository.Rd: Fixed bug in documentation.
170 :    
171 : feinerer 704 2007-01-12 Ingo Feinerer <h0125130@wu-wien.ac.at>
172 :    
173 :     * DESCRIPTION: Update to version 0.1-1.
174 :    
175 : feinerer 702 2007-01-09 Ingo Feinerer <h0125130@wu-wien.ac.at>
176 :    
177 :     * R/textdoccol.R (stemDoc): Use Rstem::wordStem instead of
178 :     wordStem.
179 :    
180 : feinerer 698 2007-01-06 Ingo Feinerer <h0125130@wu-wien.ac.at>
181 :    
182 :     * R/: Changes due to Kurt's review.
183 :    
184 : feinerer 694 2006-12-31 Ingo Feinerer <h0125130@wu-wien.ac.at>
185 :    
186 :     * R/: Implemented improvements based upon comments by David
187 :     Meyer.
188 :    
189 : feinerer 691 2006-12-17 Ingo Feinerer <h0125130@wu-wien.ac.at>
190 :    
191 :     * inst/doc/: Rewrote vignette.
192 :    
193 :     * man/: Improved documentation.
194 :    
195 : feinerer 690 2006-12-16 Ingo Feinerer <h0125130@wu-wien.ac.at>
196 :    
197 :     * man/: Updated documentation.
198 :    
199 :     * DESCRIPTION: Changed package name to "tm". Updated version to
200 :     0.1 for first CRAN release.
201 :    
202 :     * inst/texts/gmane.comp.lang.r.general.mbox: mbox Gmane R mailing
203 :     list archive example.
204 :    
205 :     * inst/texts/gmane.comp.lang.r.gr.rdf: RSS Gmane R mailing list
206 :     archive example.
207 :    
208 :     * R/preprocess.R (convert_mbox_eml): A simple e-mail converter
209 :     from (several mails per box) mbox format to (single mail per file)
210 :     eml format.
211 :    
212 : feinerer 689 2006-12-08 Ingo Feinerer <h0125130@wu-wien.ac.at>
213 :    
214 :     * data/crude.rda: Rebuilt.
215 :    
216 :     * data/acq.rda: Rebuilt.
217 :    
218 :     * R/reader.R: Factored out reader and parser methods from
219 :     textdoccol.R.
220 :    
221 :     * R/source.R: Factored out Source methods from aobjects.R and
222 :     textdoccol.R.
223 :     (GmaneRSource): Encapsulates Gmane R mailing list archive RSS
224 :     feeds.
225 :    
226 :     * R/textdoccol.R (DirSource): Added support for recursive
227 :     traversal of directories.
228 :    
229 :     2006-12-07 Ingo Feinerer <h0125130@wu-wien.ac.at>
230 :    
231 :     * R/textdoccol.R ([[): Loads the document corpus automatically
232 :     into memory upon access.
233 :     (tm_transform, tm_filter): Removed several checks whether the
234 :     document is already loaded ([[ ensures this now).
235 :     (gmane_r_reader): Reader for RSS feeds as provided by the Gmane R
236 :     mailing list archive.
237 :    
238 :     2006-12-06 Ingo Feinerer <h0125130@wu-wien.ac.at>
239 :    
240 :     * R/aobjects.R (TextDocument): Is now a virtual class.
241 :     (Source): Is now a virtual class.
242 :    
243 :     2006-12-05 Ingo Feinerer <h0125130@wu-wien.ac.at>
244 :    
245 :     * R/textdoccol.R (c): Support for an arbitrary number of document
246 :     collections.
247 :    
248 : feinerer 77 2006-11-26 Ingo Feinerer <h0125130@wu-wien.ac.at>
249 :    
250 :     * R/textrepo.R: Updated TextRepository (constructor), append_elem,
251 :     append_meta and remove_meta.
252 :    
253 :     * R/textdoccol.R: Removed modify_metadata method.
254 :    
255 :     * R/textrepo.R: Removed modify_metadata method.
256 :    
257 :     * R/textdoccol.R (remove_meta): Supports removal of document
258 :     collection metadata and document (= in data frame) metadata.
259 :    
260 : feinerer 76 2006-11-23 Ingo Feinerer <h0125130@wu-wien.ac.at>
261 :    
262 :     * R/textdoccol.R (append_doc): Bug fix for handling empty metadata.
263 :    
264 :     * data/crude.rda: Rebuilt.
265 :    
266 :     * data/acq.rda: Rebuilt.
267 :    
268 :     * inst/doc/textmin.Rnw: Updated vignette to reflect code changes.
269 :    
270 :     * R/textdoccol.R ([): Bug fix for subsetting a document
271 :     collection's data frame.
272 :    
273 : feinerer 75 2006-11-22 Ingo Feinerer <h0125130@wu-wien.ac.at>
274 :    
275 :     * R/textdoccol.R: Bug fixes in s_filter. Added full query support
276 :     to s_filter.
277 :    
278 :     * R/textdoccol.R: Local text documents' metadata can now be copied
279 :     to a document collection's data frame with prescind_meta.
280 :    
281 : feinerer 73 2006-11-21 Ingo Feinerer <h0125130@wu-wien.ac.at>
282 :    
283 : feinerer 74 * R/: Text documents' slot metadata is now accessible in s_filter.
284 :    
285 : feinerer 73 * R/: Rewrote s_filter function (has still some restrictions).
286 :    
287 : feinerer 72 2006-11-20 Ingo Feinerer <h0125130@wu-wien.ac.at>
288 :    
289 :     * R/: Various fixes in handling metadata.
290 :    
291 :     * R/: Added update mechanism for text document collections.
292 :    
293 : feinerer 71 2006-11-19 Ingo Feinerer <h0125130@wu-wien.ac.at>
294 :    
295 :     * R/: Merging of document collections now creates a binary tree
296 :     for reconstructing merged document collections.
297 :    
298 :     * R/: Redesign of metadata for document collections.
299 :    
300 : feinerer 70 2006-11-07 Ingo Feinerer <h0125130@wu-wien.ac.at>
301 :    
302 :     * R/: Messages now use \code{ngettext}.
303 :    
304 : feinerer 69 2006-11-03 Ingo Feinerer <h0125130@wu-wien.ac.at>
305 :    
306 :     * R/: Added functions for modifying and removing metadata.
307 :    
308 : feinerer 67 2006-11-01 Ingo Feinerer <h0125130@wu-wien.ac.at>
309 :    
310 :     * man/: Updated some documentation.
311 :    
312 :     * R/: Corrected some connection issues.
313 :    
314 :     * inst/doc: Worked on the vignette.
315 :    
316 : feinerer 65 2006-10-31 Ingo Feinerer <h0125130@wu-wien.ac.at>
317 :    
318 : feinerer 66 * inst/: Added texts and started vignette.
319 :    
320 : feinerer 65 * R/: Final changes based upon David's comments.
321 :    
322 : feinerer 64 2006-10-29 Ingo Feinerer <h0125130@wu-wien.ac.at>
323 :    
324 :     * NAMESPACE: Corrected exports (generic methods need exportMethods
325 :     directives!).
326 :    
327 : feinerer 63 2006-10-26 Ingo Feinerer <h0125130@wu-wien.ac.at>
328 :    
329 :     * R/: Modified the TextDocCol constructur and various parsers. It
330 :     is now modular and supports various file formats via plugins (see
331 :     the new "Source" class).
332 :    
333 : feinerer 62 2006-10-24 Ingo Feinerer <h0125130@wu-wien.ac.at>
334 :    
335 :     * man/: Revised documentation after previous code changes.
336 :    
337 : feinerer 61 2006-10-23 Ingo Feinerer <h0125130@wu-wien.ac.at>
338 :    
339 :     * R/: Remaining changes as discussed with David.
340 :    
341 : feinerer 60 2006-10-22 Ingo Feinerer <h0125130@wu-wien.ac.at>
342 :    
343 :     * R/: Some changes as suggested by David. The rest will follow
344 :     within the next days.
345 :    
346 : feinerer 59 2006-09-26 Ingo Feinerer <h0125130@wu-wien.ac.at>
347 :    
348 :     * man/: Finished documentation.
349 :    
350 : feinerer 58 2006-09-25 Ingo Feinerer <h0125130@wu-wien.ac.at>
351 :    
352 :     * man/: Wrote some documentation.
353 :    
354 : feinerer 56 2006-09-24 Ingo Feinerer <h0125130@wu-wien.ac.at>
355 :    
356 :     * R/: Further syntactic sugar in form of additional assignment and
357 :     accessor methods.
358 :    
359 : feinerer 54 2006-09-13 Ingo Feinerer <h0125130@wu-wien.ac.at>
360 :    
361 :     * R/: Syntactic sugar in form of "length", "show" and "summary"
362 : feinerer 56 operators.
363 : feinerer 54
364 : feinerer 53 2006-08-24 Ingo Feinerer <h0125130@wu-wien.ac.at>
365 :    
366 :     * R/: Diverse updates. Mainly on default operators ("[" or "c")
367 :     and dissimilarities.
368 :    
369 : feinerer 52 2006-08-12 Ingo Feinerer <h0125130@wu-wien.ac.at>
370 :    
371 :     * R/: Added similarity functions.
372 :    
373 :     * data/: Added english stopwords.
374 :    
375 : feinerer 50 2006-08-07 Ingo Feinerer <h0125130@wu-wien.ac.at>
376 :    
377 : feinerer 51 * data/: Examples compiled for new features
378 :    
379 :     * R/: Changes due to new structure.
380 :    
381 : feinerer 50 * NAMESPACE: Corrected namespace to reflect new structure.
382 :    
383 :     * R/termdocmatrix.R: Adapted for new naming scheme.
384 :    
385 : feinerer 49 2006-08-06 Ingo Feinerer <h0125130@wu-wien.ac.at>
386 :    
387 :     * R/textdoccol.R: Adapted code for new class structure. Wrote
388 :     several transform and filter functions operating on text document
389 :     collections (alias text document databases).
390 :    
391 :     * R/aobjects.R: Adapted class structure with inheritance,
392 :     repositories and additional meta data. Loading files on demand is
393 :     now possible.
394 :    
395 : feinerer 48 2006-07-13 Ingo Feinerer <h0125130@wu-wien.ac.at>
396 :    
397 :     * R/: Some cosmetic cleanups.
398 :    
399 :     * inst/: Removed vignette on clustering. That and much more is now
400 :     described in the JSS paper on text mining. Based upon that
401 :     article an elaborated vignette will be incorporated in the future.
402 :    
403 : feinerer 42 2006-07-01 Ingo Feinerer <h0125130@wu-wien.ac.at>
404 :    
405 :     * R/: Updated generic S4 methods to comply with signature changes
406 :     in newer versions of R (> 2.3)
407 :    
408 : feinerer 41 2006-03-12 Ingo Feinerer <h0125130@wu-wien.ac.at>
409 :    
410 :     * ext/R/importRIS.R: Automatic RIS import is now possible.
411 :    
412 : feinerer 40 2006-02-14 Ingo Feinerer <h0125130@wu-wien.ac.at>
413 :    
414 :     * R/textdoccol.R: Added RIS HTML input format.
415 :    
416 : feinerer 39 2006-01-21 Ingo Feinerer <h0125130@wu-wien.ac.at>
417 :    
418 :     * R/textdoccol.R: Removed bug that caused invalid text document
419 :     collections when handling many input files.
420 :    
421 : feinerer 36 2006-01-11 Ingo Feinerer <h0125130@wu-wien.ac.at>
422 :    
423 : feinerer 37 * R/textdoccol.R: Restructured and extended file import
424 :     mechanism.
425 :    
426 : feinerer 36 * inst/doc/clustering.Rnw: Adapted vignette for use with
427 :     ReutNews.rda
428 :    
429 :     * man/ReutNews.Rd: Documentation for ReutNews.rda
430 :    
431 :     * data/ReutNews.rda: A tiny Reuters21578 example data set.
432 :    
433 : feinerer 34 2005-12-22 Ingo Feinerer <h0125130@wu-wien.ac.at>
434 :    
435 :     * inst/doc/clustering.Rnw: Wrote a small vignette to present the
436 :     clustering facilities of this package.
437 :    
438 : feinerer 33 2005-12-15 Ingo Feinerer <h0125130@wu-wien.ac.at>
439 :    
440 :     * R/aobjects.R: Changed package document structure to avoid class
441 :     dependency problems.
442 :    
443 : feinerer 28 2005-12-06 Ingo Feinerer <h0125130@wu-wien.ac.at>
444 :    
445 : feinerer 29 * Wrote a script for the ModLewis Split for the Reuters-21578 XML
446 :     data set.
447 :    
448 : feinerer 28 * Finished documentation and reordered directory structure. Now "R
449 :     CMD check textmin" works without errors.
450 :    
451 : feinerer 27 2005-12-04 Ingo Feinerer <h0125130@wu-wien.ac.at>
452 :    
453 :     * src/: Various splits can now be easily created for the
454 :     Reuters21578 data set.
455 :    
456 : feinerer 26 2005-12-03 Ingo Feinerer <h0125130@wu-wien.ac.at>
457 :    
458 :     * Updated documentation
459 :    
460 : feinerer 25 2005-11-30 Ingo Feinerer <h0125130@wu-wien.ac.at>
461 :    
462 :     * Wrote R documentation for some classes and methods.
463 :    
464 : feinerer 21 2005-11-19 Ingo Feinerer <h0125130@wu-wien.ac.at>
465 :    
466 : feinerer 22 * R/textdoccol.R: Constructor of textdoccol allows import of CSV
467 :     files. See the questionnaire data/Umfrage.csv for such an example.
468 : feinerer 23 We are now able to import files in Reuters-21578 XML format.
469 : feinerer 22
470 : feinerer 21 * Changed class interfaces in various files. Weighting of the text
471 :     matrix is now possible.
472 :    
473 : feinerer 20 2005-11-08 Ingo Feinerer <h0125130@wu-wien.ac.at>
474 :    
475 :     * R/textdoccol.R: One can build term-document matrices if
476 :     nessecary (with buildTDM(...)) and fill the field tdm from a text
477 :     document collection with it.
478 :    
479 :     * R/textmatrix.R: Wrote S4 class for term-document matrices.
480 :    
481 : feinerer 19 2005-11-06 Ingo Feinerer <h0125130@wu-wien.ac.at>
482 :    
483 :     * R/textdoccol.R: We now can read in a whole XML file with several
484 :     news items.
485 :    
486 : feinerer 17 2005-11-05 Ingo Feinerer <h0125130@wu-wien.ac.at>
487 :    
488 :     * R/textdoccol.R: Set up an S4 class for a collection of text
489 :     documents. A first attempt to read in XML input (like the RCV1
490 :     set) was made.
491 :    
492 :     * R/textdocument.R: Set up an S4 class for text documents. Wrote
493 :     some accessor functions.
494 :    
495 :     * data/newsitem.xml: Added this XML file for testing purposes. It
496 :     contains a single news item from the Reuters Corpus Volume 1
497 :     (RCV1) XML set.
498 :    
499 : feinerer 16 2005-10-07 Ingo Feinerer <h0125130@wu-wien.ac.at>
500 :    
501 :     * R/textmatrix.R (textmatrix): Removed the transpose of the original
502 :     textmatrix as k-means clustering provided by R (kmeans) now works on
503 :     this textmatrix. The result is a k-means text clustering with a
504 :     similarity measure based upon word frequences.
505 :    
506 :     2005-10-05 Ingo Feinerer <h0125130@wu-wien.ac.at>
507 :    
508 :     * R/textmatrix.R: Adapted the preprocessing code from the R
509 :     package "lsa" written by Fridolin Wild to build a document text matrix.
510 :    
511 :     2005-10-02 Ingo Feinerer <h0125130@wu-wien.ac.at>
512 :    
513 :     * Set up the R Text Mining Package infrastructure.

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge