SCM

SCM Repository

[tm] Diff of /pkg/ChangeLog
ViewVC logotype

Diff of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/R/textmin/ChangeLog revision 59, Tue Sep 26 12:24:09 2006 UTC pkg/ChangeLog revision 1200, Fri Dec 14 15:07:38 2012 UTC
# Line 1  Line 1 
1    2012-12-14  Ingo Feinerer <feinerer@logic.at>
2    
3            * R/matrix.R (TermDocumentMatrix): Ensure dimnames of type character
4            when generating a simple_triplet_matrix. Reported by Arho Suominen.
5    
6    2012-12-10  Ingo Feinerer <feinerer@logic.at>
7    
8            * man/tm_reduce.Rd: Document right to left folding order. Adapt
9            example as well. Suggested by Mark Rosenstein.
10    
11    2012-12-04  Ingo Feinerer <feinerer@logic.at>
12    
13            * R/filter.R (sFilter): Avoid attach() and simplify.
14    
15    2012-11-02  Ingo Feinerer <feinerer@logic.at>
16    
17            * R/doc.R (.TextDocument): Use casts to ensure data types and to avoid
18            removal of attributes.
19    
20    2012-10-03 Ingo Feinerer  <feinerer@logic.at>
21    
22            * R/weight.R (weightTfIdf, weightSMART): Gracefully handle empty
23            columns and rows (avoids blow-up due to NaN values). Suggested by Jaap
24            Frölich.
25    
26    2012-07-27 Ingo Feinerer  <feinerer@logic.at>
27    
28            * R/transform.R (removeWords): Allow longer stopword lists.
29    
30    2012-01-31  Ingo Feinerer  <feinerer@logic.at>
31    
32            * R/reader.R (readXML): Readers can now set the document language
33            themselves.
34    
35    2012-01-14  Ingo Feinerer  <feinerer@logic.at>
36    
37            * R/source.R (XMLSource, getElem.XMLSource): Simplifications as
38            proposed by Milan Bouchet-Valat.
39    
40    2012-01-11  Ingo Feinerer  <feinerer@logic.at>
41    
42            * R/matrix.R (termFreq): Fix processing of user provided
43            stopwords. Reported by Bettina Grün.
44    
45    2011-12-23  Ingo Feinerer  <feinerer@logic.at>
46    
47            * R/matrix.R (termFreq): Fix invalid handling of
48            control$wordLengths[1]. Reported by Steven C. Bagley.
49    
50    2011-12-17  Ingo Feinerer  <feinerer@logic.at>
51    
52            * DESCRIPTION (Version): Prepare for CRAN Christmas release.
53    
54    2011-12-12  Ingo Feinerer  <feinerer@logic.at>
55    
56            * R/utils.R (map_IETF_Snowball): Map empty input to "porter".
57    
58    2011-12-07  Ingo Feinerer  <feinerer@logic.at>
59    
60            * R/transform.R (removePunctuation): Add option to preserve
61            intra-word dashes.
62    
63    2011-12-06  Ingo Feinerer  <feinerer@logic.at>
64    
65            * R/matrix.R (termFreq): Allow reordering of control option
66            processing.
67    
68    2011-11-17  Ingo Feinerer  <feinerer@logic.at>
69    
70            * R/reader.R (readPDF): Use tools:::pdf_info() instead of external
71            pdfinfo tool.
72    
73            * inst/stopwords/SMART.dat: Add SMART information retrieval system
74            stopwords (which are also used by the MC toolkit).
75    
76            * R/matrix (termFreq): Allow local option \code{bounds$local} to
77            restrict how often a term may appear in each document (generalizes
78            \code{minDocFreq}). Similarly the local option \code{wordLenghts}
79            for word length bounds (generalizes \code{minWordLength}).
80    
81            * R/matrix.R (TermDocumentMatrix.VCorpus): New global option
82            \code{bounds$global} for restricting how often a term is allowed
83            to appear in different documents.
84    
85            * R/matrix.R (TermDocumentMatrix.VCorpus): Distinguish between
86            local options delegated internally to termFreq() and global
87            options which are processed by the term-document matrix
88            constructor itself.
89    
90    2011-11-15  Ingo Feinerer  <feinerer@logic.at>
91    
92            * man/getTokenizers.Rd: Document getTokenizers().
93    
94            * man/tokenizer.Rd: Document MC_tokenizer() and scan_tokenizer().
95    
96    2011-11-04  Ingo Feinerer  <feinerer@logic.at>
97    
98            * man/matrix.Rd: Document as.TermDocumentMatrix.term_frequency.
99    
100            * man/combine.Rd: Document c.term_frequency().
101    
102    2011-10-11  Ingo Feinerer  <feinerer@logic.at>
103    
104            * R/meta.R (`meta<-.Corpus`): Assume that the replacement value
105            can be accessed via '[' and not '[['.
106    
107    2011-08-24  Ingo Feinerer  <feinerer@logic.at>
108    
109            * R/stopwords.R (stopwords): Raise an error if no stopwords are
110            available for requested language. Suggested by Derek M Jones.
111    
112    2011-05-27  Ingo Feinerer  <feinerer@logic.at>
113    
114            * R/weight.R (weightSMART): Implement Cosine and pivoted unique
115            normalization.
116    
117    2011-02-17  Ingo Feinerer  <feinerer@logic.at>
118    
119            * R/transform.R (stemDocument.PlainTextDocument): Use language
120            argument.
121    
122    2011-02-04  Ingo Feinerer  <feinerer@logic.at>
123    
124            * R/source.R: Store strings and connections instead of unevaluated
125            calls.
126    
127    2010-11-26  Ingo Feinerer  <feinerer@logic.at>
128    
129            * R/corpus.R (Corpus): Allow init and exit hooks for readers.
130    
131    2010-10-22  Ingo Feinerer  <feinerer@logic.at>
132    
133            * R/matrix.R (.TermDocumentMatrix): Make Weighting an attribute
134            (instead of a list element).
135    
136    2010-10-16  Ingo Feinerer  <feinerer@logic.at>
137    
138            * R/corpus.R (`[[.VCorpus`, `[[.PCorpus'): Access individual
139            documents by names (fallback to IDs if names are not set).
140    
141    2010-08-25  Ingo Feinerer  <feinerer@logic.at>
142    
143            * R/corpus.R (c.Corpus): When concatenating corpora, the argument
144            \code{recursive} now determines whether existing corpus meta data
145            is used.
146    
147    2010-08-06  Ingo Feinerer  <feinerer@logic.at>
148    
149            * R/transform.R: Removed convert_UTF_8(). Use enc2utf8() instead.
150    
151    2010-06-17  Ingo Feinerer  <feinerer@logic.at>
152    
153            * R/matrix.R (TermDocumentMatrix): If a dictionary is given do not
154            remove terms not occurring in the corpus anymore.
155    
156    2010-06-02  Ingo Feinerer  <feinerer@logic.at>
157    
158            * R/plot.R (Zipf_plot, Heaps_plot): Plotting functions for Zipf's
159            and Heaps' law.
160    
161    2010-05-18  Ingo Feinerer  <feinerer@logic.at>
162    
163            * R/corpus.R (Corpus, PCorpus): Use element names as IDs if
164            provided by a source.
165    
166    2010-04-09  Ingo Feinerer  <feinerer@logic.at>
167    
168            * R/source.R (.Source): Provide document names.
169    
170    2010-04-07  Ingo Feinerer  <feinerer@logic.at>
171    
172            * R/meta.R (`content_or_meta`): Utility function.
173    
174    2010-03-19  Ingo Feinerer  <feinerer@logic.at>
175    
176            * R/reader.R (readReut21578XML, readReut21578XMLasPlain): Extract
177            TOPICS, LEWISSPLIT, CGISPLIT, and OLDID meta tags.
178    
179    2010-03-03  Ingo Feinerer  <feinerer@logic.at>
180    
181            * R/weight.R (weightTfIdf): Added normalization option.
182    
183            * man/tm_tag_score.Rd: Add General Inquirer example for sentiment
184            analysis.
185    
186    2010-02-25  Ingo Feinerer  <feinerer@logic.at>
187    
188            * R/score.R (tm_tag_score): Compute a score from the number of
189            tags matching in a document.
190    
191    2010-02-18  Ingo Feinerer  <feinerer@logic.at>
192    
193            * R/complete.R (stemCompletion): New completion heuristics.
194    
195    2010-02-17  Ingo Feinerer  <feinerer@logic.at>
196    
197            * R/plot.R (plot.TermDocumentMatrix): Memory improvements.
198    
199    2010-02-06  Ingo Feinerer  <feinerer@logic.at>
200    
201            * DESCRIPTION (Depends): Depend on R (>= 2.10.0) to ensure that
202            setOldClass(c(..., "list")) works.
203    
204    2010-01-22  Ingo Feinerer  <feinerer@logic.at>
205    
206            * R/transform.R (stemDocument.character): In case input is a
207            simple character just delegate to the default Snowball stemmer.
208    
209    2010-01-15  Ingo Feinerer  <feinerer@logic.at>
210    
211            * R/reader.R (readReut21578XML, readRCV1): Extract more meta
212            data.
213    
214    2010-01-12  Ingo Feinerer  <feinerer@logic.at>
215    
216            * R/doc.R (`Content<-`): Be careful with names attribute.
217    
218    2010-01-07  Stefan Theussl  <stefan.theussl@wu.ac.at>
219    
220            * R/source.R (DirSource): Improved implementation especially when
221            handling many (> 1M) files.
222    
223    2009-12-22  Ingo Feinerer  <feinerer@logic.at>
224    
225            * R/source.R (getElem.URISource): Use encoding argument.
226    
227    2009-12-11  Ingo Feinerer  <feinerer@logic.at>
228    
229            * R/doc.R (setOldClass): Register S3 document classes to be
230            recognized by S4 methods.
231    
232    2009-11-25  Ingo Feinerer  <feinerer@logic.at>
233    
234            * R/matrix.R (termFreq): Add option to remove punctuation
235            characters.
236    
237    2009-11-19  Ingo Feinerer  <feinerer@logic.at>
238    
239            * R/matrix.R (c.TermDocumentMatrix): Added combine method for
240            merging multiple term-document matrices.
241    
242    2009-11-17  Ingo Feinerer  <feinerer@logic.at>
243    
244            * R/corpus.R (setOldClass): Register S3 corpus classes to be
245            recognized by S4 methods.
246    
247            * man/plot.Rd: Use \dontrun{} in \examples{} section in the hope
248            that CRAN Mac OS X builds do not fail any longer.
249    
250    2009-11-15  Ingo Feinerer  <feinerer@logic.at>
251    
252            * R/matrix.R (tokenize): Use scan(..., what = "character") instead
253            of RWeka:AlphabeticTokenizer() as default.
254    
255    2009-11-14  Ingo Feinerer  <feinerer@logic.at>
256    
257            * R/transform.R (removeWords.PlainTextDocument): Fix bug which
258            caused words at the beginning or the end of a line not to be removed. Do
259            not delete whitespace anymore.
260    
261    2009-11-12  Ingo Feinerer  <feinerer@logic.at>
262    
263            * R/source.R (DirSource): Default to working directory if no path
264            is specified.
265    
266    2009-11-11  Ingo Feinerer  <feinerer@logic.at>
267    
268            * R/source.R (DirSource): Stop on empty directories.
269    
270    2009-11-07  Ingo Feinerer  <feinerer@logic.at>
271    
272            * R/matrix.R (TermDocumentMatrix): Avoid prefixes originating from
273            named documents.
274    
275    2009-10-21  Ingo Feinerer  <feinerer@logic.at>
276    
277            * R/transform.R (removeWords): Improve regular expressions.
278    
279    2009-10-19  Ingo Feinerer  <feinerer@logic.at>
280    
281            * R/meta.R (DublinCore): Allow lower case tags.
282    
283    2009-10-09  Ingo Feinerer  <feinerer@logic.at>
284    
285            * R/source.R (GmaneSource, ReutersSource): Use xmlChildren(x)
286            instead of x$children.
287    
288    2009-09-15  Ingo Feinerer  <feinerer@logic.at>
289    
290            * R/preprocess.R (preprocessReut21578XML): Fix generated file names.
291    
292    2009-09-06  Ingo Feinerer  <feinerer@logic.at>
293    
294            * R/: Use S3 instead of S4 class system.
295    
296    2009-08-11  Ingo Feinerer  <feinerer@logic.at>
297    
298            * R/reader.R (readMail): Moved to tm.plugin.mail package.
299    
300    2009-07-04  Ingo Feinerer  <feinerer@logic.at>
301    
302            * R/reader.R (readNewsgroup): Rename to readMail as newsgroup
303            postings are basically e-mails with some extra headers.
304    
305    2009-07-03  Ingo Feinerer  <feinerer@logic.at>
306    
307            * R/transform.R: Move convertMboxEml, removeCitation,
308            removeMultipart, and removeSignature to the tm.plugin.mail package
309            since they are mainly utility functions (for handling e-mails) and
310            not very framework specific.
311    
312    2009-06-28  Ingo Feinerer  <feinerer@logic.at>
313    
314            * man/: Fix documentation.
315    
316    2009-06-26  Ingo Feinerer  <feinerer@logic.at>
317    
318            * R/reader.R (readReut21578XMLasPlain): New reader which returns a
319            plain text document instead of an XML document for texts of the
320            Reuters-21578 dataset.
321    
322            * R/sparse.R: Removed since the slam package is now available on
323            CRAN.
324    
325            * DESCRIPTION (Depends): Add slam package.
326    
327    2009-06-17  Ingo Feinerer  <feinerer@logic.at>
328    
329            * R/transform.R (stemDoc): Fix character(0) handling.
330    
331    2009-06-12  Ingo Feinerer  <feinerer@logic.at>
332    
333            * R/doc.R (show): Pretty print.
334    
335    2009-05-27  Ingo Feinerer  <feinerer@logic.at>
336    
337            * R/matrix.R (print.TermDocumentMatrix): Handle empty matrices
338            gracefully.
339    
340    2009-05-13  Ingo Feinerer  <feinerer@logic.at>
341    
342            * R/corpus.R: Make corpus virtual. Implement corpus with standard
343            and permanent storage semantics.
344    
345            * DESCRIPTION: New major release. A *lot* of improvements.
346    
347    2009-05-04   Ingo Feinerer <feinerer@logic.at>
348    
349            * NAMESPACE: Export some simple_triplet_matrix functions.
350    
351    2009-04-28   Ingo Feinerer <feinerer@logic.at>
352    
353            * R/weight.R: Adapt tf-idf to new matrix format.
354    
355    2009-04-27  Ingo Feinerer  <feinerer@logic.at>
356    
357            * R/matrix.R: Create two distinct classes for term-document and
358            document-term matrices.
359    
360    2009-04-26  Ingo Feinerer  <feinerer@logic.at>
361    
362            * R/termdocmatrix.R: No longer use Matrix package. This reduces
363            package start-up time significantly.
364    
365    2009-04-11  Ingo Feinerer  <feinerer@logic.at>
366    
367            * inst/doc/tm.Rnw: Fix code/documentation mismatch.
368    
369    2009-04-04  Ingo Feinerer  <feinerer@logic.at>
370    
371            * R/transform.R (tmReduce): Combine multiple maps into one
372            transformation.
373    
374    2009-04-03  Ingo Feinerer  <feinerer@logic.at>
375    
376            * R/weight.R: Remove weightLogical since it does not return a
377            dgCMatrix.
378    
379            * R/termdocmatrix.R: Removed TermDocMatrix. Use DocumentTermMatrix
380            or TermDocumentMatrix instead.
381    
382    2009-03-28  Ingo Feinerer  <feinerer@logic.at>
383    
384            * inst/doc/extensions.Rnw: Finished vignette.
385    
386    2009-03-27  Ingo Feinerer  <feinerer@logic.at>
387    
388            * R/termdocmatrix.R: Start to work on new TermDocumentMatrix and
389            DocumentTermMatrix representations.
390    
391    2009-03-23  Ingo Feinerer  <feinerer@logic.at>
392    
393            * R/reader.R (readXML): New reader for arbitrary XML files.
394    
395    2009-03-22  Ingo Feinerer  <feinerer@logic.at>
396    
397            * R/source.R (CSVSource): Defunct (use DataframeSource instead).
398            (XMLSource): New XMLSource class for arbitrary XML files.
399            (Source): New slot Vectorized.
400    
401    2009-03-21  Ingo Feinerer  <feinerer@logic.at>
402    
403            * R/reader.R (readTabular): Experimental reader for tabular data
404            structures which can be customized via user-defined mappings.
405    
406            * R/reader.R: Always use UTC time zone.
407    
408            * R/AAA.R (.onLoad): No longer try to start a MPI cluster.
409    
410    2009-03-20  Ingo Feinerer  <feinerer@logic.at>
411    
412            * R/reader.R (readDOC): Options can be passed over to antiword.
413    
414            * R/reader.R (readPDF): Options can be passed over to pdfinfo and
415            pdftotext.
416    
417    2009-03-10  Ingo Feinerer  <feinerer@logic.at>
418    
419            * R/source.R (DirSource): Add pattern and ignore.case arguments
420            which are internally passed over to list.files().
421    
422    2009-03-02  Ingo Feinerer  <feinerer@logic.at>
423    
424            * inst/doc/tm.Rnw: Suppress pointless loading message.
425    
426    2009-01-29  Ingo Feinerer  <feinerer@logic.at>
427    
428            * DESCRIPTION: Speed up package loading (via moving packages not
429            strictly necessary for normal operation to Suggests instead of
430            Depends).
431    
432    2009-01-08  Ingo Feinerer  <feinerer@logic.at>
433    
434            * R/reader.R (readNewsgroup): The date format is now configurable.
435    
436    2008-12-20  Ingo Feinerer  <feinerer@logic.at>
437    
438            * R/preprocess.R (convertMboxEml): Fix off-by-one error.
439    
440    2008-12-16  Ingo Feinerer  <feinerer@logic.at>
441    
442            * R/termdocmatrix.R (TermDocMatrix): Sort row indices.
443    
444    2008-12-06  Ingo Feinerer  <feinerer@logic.at>
445    
446            * R/source.R (DataframeSource): New source class for data frames.
447    
448            * R/source.R: Fixed non-standard call evaluation.
449    
450    2008-11-29  Ingo Feinerer  <feinerer@logic.at>
451    
452            * R/source.R (URISource): New source class for a single document.
453    
454    2008-11-27  Ingo Feinerer  <feinerer@logic.at>
455    
456            * R/source.R: Refactoring.
457    
458    2008-11-25  Ingo Feinerer  <feinerer@logic.at>
459    
460            * R/AAA.R (.onLoad, .Last): Use tryCatch() to handle misconfigured
461            Rmpi installations more gracefully.
462    
463    2008-11-08  Ingo Feinerer  <feinerer@logic.at>
464    
465            * R/source.R (Source): Add Length slot.
466    
467    2008-11-06  Ingo Feinerer  <feinerer@logic.at>
468    
469            * R/AAA.R: Unify duplicated .onLoad function.
470    
471    2008-11-03  Ingo Feinerer  <feinerer@logic.at>
472    
473            * DESCRIPTION (Suggests): Added Rmpi.
474    
475    2008-11-02  Ingo Feinerer  <feinerer@logic.at>
476    
477            * R/source.R (getElem): Fix 'no visible binding' warning.
478    
479            * man/WeightFunction.Rd: Fix signature.
480    
481    2008-08-03  Ingo Feinerer  <feinerer@logic.at>
482    
483            * R/weight.R: Introduce name abbreviations for weighting functions.
484    
485    2008-07-24  Ingo Feinerer  <feinerer@logic.at>
486    
487            * R/AAA.R (.onLoad, .Last): Start and stop MPI cluster.
488    
489            * R/cluster.R: Provide convenience functions for using a MPI
490            cluster.
491    
492            * R/termdocmatrix.R (TermDocMatrix): Use MPI cluster if
493            available.
494    
495            * R/textdoccol.R (tmIndex, tmFilter, tmMap): Use MPI cluster if
496            available.
497    
498    2008-07-17  Ingo Feinerer  <feinerer@logic.at>
499    
500            * R/textdoccol.R (lapply): Removed debug print out.
501    
502    2008-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
503    
504            * R/reader.R (readRCV1): Improved meta data extraction from
505            Reuters Corpus Volume 1 documents.
506    
507    2008-05-25  Ingo Feinerer  <h0125130@wu-wien.ac.at>
508    
509            * R/transform.R: Ensure that all mappings preserve multiline
510            structures.
511    
512    2008-05-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
513    
514            * R/filter.R: Every filter has now an attribute indicating whether
515            it sould be applied to document level (doclevel).
516    
517            * R/textdoccol.R (tmFilter): Set searchFullText as new default
518            filter.
519    
520    2008-04-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
521    
522            * R/transform.R (replacePatterns): Replaced removeWords by
523            replacePatterns. Suggested by Christian Buchta.
524    
525            * R/textdoccol.R (inspect): Improved formatting.
526    
527    2008-04-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
528    
529            * inst/CITATION: Updated JSS article information.
530    
531            * R/textdoccol.R (setAs): Added coerce method from list to
532            corpus.
533    
534            * R/meta.R (meta): Improved meta data handling.
535    
536    2008-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
537    
538            * R/textdoccol.R (materialize, tmMap): Improvements suggested by
539            Christian Buchta.
540    
541            * inst/CITATION: Added template to include JSS article reference.
542    
543    2008-03-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
544    
545            * R/textdoccol.R (tmMap): Introduced lazy mapping.
546    
547            * R/source.R: Added VectorSource.
548    
549    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
550    
551            * man/: Language codes should be in ISO 639-1 format.
552    
553            * R/textdoccol.R (asPlain): Preserve local meta data.
554    
555    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
556    
557            * R/textdoccol.R (writeCorpus): Function for writing a corpus
558            containing plain text documents to disk.
559    
560    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
561    
562            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
563            always set correctly.
564    
565            * R/textdoccol.R: Set load = TRUE as default for load on demand
566            since in most cases this is the wanted behaviour.
567    
568    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
569    
570            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
571    
572            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
573    
574    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
575    
576            * R/meta.R (meta): New function for consistent access to meta data
577            of document collections, repositories, and texts.
578    
579    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
580    
581            * R/: Better support for encodings.
582    
583    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
584    
585            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
586            selection when no reader argument is given.
587    
588    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
589    
590            * R/source.R (CSVSource): Now uses read.csv instead of scan
591            internally.
592    
593    2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
594    
595            * R/reader.R (getReaders): Returns available reader functions.
596    
597            * R/termdocmatrix.R (TermDocMatrix): Set new modular constructor
598            as default.
599    
600    2007-12-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
601    
602            * R/stopwords.R (stopwords): Shortened code, removed codetools
603            variable warnings.
604    
605            * man/: Documentation for showMeta, added an example for tmMap.
606    
607            * inst/doc/tm.Rnw: Updated vignette, comments on MS word reader,
608            some minor typos fixed.
609    
610    2007-12-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
611    
612            * R/aobjects.R (showMeta): Added method for pretty printing a
613            text document's meta data.
614    
615    2007-11-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
616    
617            * R/textdoccol.R (TextDocCol): Better handling of empty
618            arguments.
619    
620            * NAMESPACE: Exported readDOC.
621    
622            * man/completeStems.Rd: Added an example.
623    
624    2007-11-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
625    
626            * R/stopwords.R (stopwords): Look up .dat files at every
627            call. Allows users to modify stopword .dat files interactively.
628    
629    2007-11-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
630    
631            * R/termdocmatrix.R (termFreq): Correct processing of empty
632            documents.
633    
634    2007-10-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
635    
636            * man/: Updated documentation.
637    
638    2007-10-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
639    
640            * R/complete.R (completeStems): Completes (heuristically) word
641            stems.
642    
643            * R/termdocmatrix.R (TermDocMatrix2): New modular
644            constructor.
645    
646            * NAMESPACE: Exported termFreq.
647    
648    2007-10-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
649    
650            * R/reader.R (readDOC): Added MS Word reader (using antiword).
651    
652    2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
653    
654            * R/weight.R: Weighting functions for TermDocMatrix.
655    
656    2007-10-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
657    
658            * R/termdocmatrix.R (dimnames, colnames, rownames): Wrapper
659            functions for accessing dimension, column, and row names.
660    
661            * R/plot.R (plot.TermDocMatrix): Plot correlations between terms.
662    
663    2007-09-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
664    
665            * man/removePunctuation.Rd: Added documentation. Function also exported to NAMESPACE.
666    
667    2007-08-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
668    
669            * R/fungen.R: Use S4 class for function generators instead of S3 attributes.
670    
671    2007-07-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
672    
673            * R/reader.R (readPDF): Removed manual checks for pdftotext and
674            pdfinfo. The system call gives a warning anyway.
675    
676    2007-07-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
677    
678            * R/textdoccol.R (asPlain): Conversion from
679            StructuredTextDocuments to PlainTextDocuments.
680    
681    2007-07-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
682    
683            * R/termdocmatrix.R: Added convenience methods ("[", nrow, ncol)
684            for accessing term-document matrices.
685    
686            * inst/doc/tm.Rnw: readPDF is only called if pdftotext and pdfinfo
687            are installed.
688    
689    2007-07-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
690    
691            * R/termdocmatrix.R (TermDocMatrix): Improved efficiency. Kudos to
692            Christian Buchta.
693    
694    2007-07-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
695    
696            * inst/doc/tm.Rnw: Update vignette (readPDF, readHTML, preprocessReut21578XML).
697    
698    2007-07-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
699    
700            * R/reader.R (readHTML): Added very simple HTML reader to obtain StructuredTextDocuments.
701    
702            * R/reader.R (readPDF): Added PDF reader.
703    
704    2007-07-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
705    
706            * DESCRIPTION: Moved proxy from Depends to Imports to avoid name clashes.
707    
708            * inst/stopwords/english.dat: Added the term "yes" to stopwords.
709    
710            * R/termdocmatrix.R (dim): dim function for TermDocMatrix.
711    
712            * R/preprocess.R (convertMboxEml): Accepts gzipped mboxes.
713    
714    2007-07-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
715    
716            * R/distmeasure.R (dissimilarity): Replaced dists call from
717            package cba by new dist call from package proxy.
718    
719    2007-07-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
720    
721            * inst/doc/tm.Rnw: Described removeSparseTerms and Dictionary.
722    
723    2007-06-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
724    
725            * R/termdocmatrix.R: require() uses the quietly option to suppress
726            loading messages.
727    
728    2007-06-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
729    
730            * R/dictionary.R: Added dictionary support.
731    
732    2007-06-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
733    
734            * R/aobjects.R: Added classes for Reuters21578 XML and RCV1
735            documents. This simplifies some functions, e.g., asPlain.
736    
737    2007-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
738    
739            * inst/doc/tm.Rnw: Fixed some typos in vignette.
740    
741    2007-06-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
742    
743            * R/textdoccol.R (replaceWords): Added method to replace a set of
744            words by a single word. Useful for synonyms.
745    
746    2007-05-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
747    
748            * man/TermDocMatrix.Rd: Fixed documentation on Data slot.
749    
750    2007-05-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
751    
752            * R/termdocmatrix.R (textvector): Small fix for dealing with empty
753            vectors. Thanks to Ariel Maguyon for his error report.
754            (removeSparseTerms): New function to remove columns from a
755            term-document matrix exceeding a sparse factor.
756    
757    2007-05-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
758    
759            * man/tmUpdate.Rd: Corrected documentation on readerControl parameter.
760    
761    2007-05-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
762    
763            * man/sFilter.Rd: Corrected documentation on statement format (use
764            '==' instead of '=').
765    
766    2007-05-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
767    
768            * R/aobjects.R (StructuredTextDocument): Inherits from
769            TextDocument.
770    
771    2007-05-04  Ingo Feinerer  <h0125130@wu-wien.ac.at>
772    
773            * R/termdocmatrix.R (findFreqTerms): Perform efficient computation
774            on sparse matrices as proposed by Martin Maechler.
775    
776    2007-04-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
777    
778            * R/textdoccol.R: Removed \code{dbDisconnect} calls since last
779            \pkg{filehash} version makes them deprecated.
780    
781    2007-04-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
782    
783            * R/termdocmatrix.R (textvector): Stemming is now performed before
784            erasing stopwords.
785            (weightMatrix): Adapted to handle sparse matrices.
786            (TermDocMatrix): Sparse matrix is now efficiently built by
787            direct stepwise insertion of row values into it.
788    
789    2007-04-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
790    
791            * DESCRIPTION: Replaced \pkg{filehashSQLite} with \pkg{filehash}
792            due to ongoing problems. For our purposes the latter is as useful
793            as the replaced package.
794    
795    2007-04-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
796    
797            * man/TextDocCol.Rd: Replaced \code{readPlain} with \code{object@DefaultReader}.
798    
799            * man/TermDocMatrix.Rd: Remove deprecated \code{language} argument.
800    
801    2007-04-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
802    
803            * R/resolve.R (resolveISOCode): Added ISO 639-1 codes for
804            languages with available stopwords.
805    
806    2007-04-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
807    
808            * inst/doc/tm.Rnw: Minor corrections in the vignette.
809    
810    2007-04-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
811    
812            * DESCRIPTION: Update to version 0.2, since a lot of new features
813            have been integrated.
814    
815            * inst/stopwords: Updated existing stopwords and added stopwords
816            for various other languages.
817    
818    2007-04-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
819    
820            * man/: Updated documentation.
821    
822            * Work/testDb.R: Script to test database stuff.
823    
824            * R/: Fixed various database related bugs. Seems to be rather
825            useable now, i.e., consider as alpha status for now.
826    
827    2007-04-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
828    
829            * R/: Fixed some bugs related to database support.
830    
831    2007-04-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
832    
833            * man/: Added a lot of examples to the manuals.
834    
835    2007-04-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
836    
837            * man/: Updated parts of the documentation.
838    
839            * R/textdoccol.R (asPlain): Added conversion from newsgroup
840            documents to plain text documents.
841    
842    2007-04-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
843    
844            * R/textdoccol.R: Finished experimental database support. Not yet
845            intensively tested.
846    
847            * R/source.R: Now each source has a default reader.
848    
849            * R/reader.R: \code{FunctionGenerator} is now an attribute, not a
850            class anymore.
851    
852            * R/plaintextdoc.R: Custom show method for plain text documents.
853    
854            * R/aobjects.R: Added a class for structured text documents.
855    
856            * R/reader.R: Replaced remaining \code{parser} occurrences with
857            \code{reader}.
858    
859            * R/textdoccol.R (summary): Indent tags.
860    
861            * R/textdoccol.R (removePunctuation): Transform method to remove
862            punctuation marks.
863    
864    2007-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
865    
866            * R/textdoccol.R (sFilter): Simplified sFilter significantly by
867            using prescindMeta().
868    
869    2007-03-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
870    
871            * R/textdoccol.R: Improved database support.
872    
873    2007-03-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
874    
875            * R/termdocmatrix.R (TermDocMatrix): Uses sparse matrices.
876    
877            * R/resolve.R (resolveISOcode): Extracts the language from a ISO
878            language code.
879    
880            * R/textdoccol.R (TextDocCol): Refactored several parser arguments
881            into parserControl argument.
882    
883            * R/aobjects.R (TextDocument): Introduced the "Language" slot.
884    
885    2007-03-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
886    
887            * Work/tmDataSetup.R: The datasets acq and crude can now be
888            created on the fly.
889    
890            * R/stopwords.R: Introduced a function returning the stopwords for
891            a given language (English, German and French at the moment)
892    
893            * R/textdoccol.R (stemDoc): Stemming uses Rstem if available,
894            otherwise falls back to Snowball package.
895    
896    2007-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
897    
898            * man/dissimilarity-methods.Rd: Make clear that any method offered
899            by "dists" from package "cba" can be used.
900    
901    2007-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
902    
903            * inst/doc/tm.Rnw: Fixed quotes-appearing-as-boxes-bug according
904            to Kurt's latex suggestion. Removed points and underscores in
905            variable names for consistent naming.
906    
907            * DESCRIPTION: Update to version 0.1-2.
908    
909            * man/TextRepository.Rd: Fixed bug in documentation.
910    
911    2007-01-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
912    
913            * DESCRIPTION: Update to version 0.1-1.
914    
915    2007-01-09  Ingo Feinerer  <h0125130@wu-wien.ac.at>
916    
917            * R/textdoccol.R (stemDoc): Use Rstem::wordStem instead of
918            wordStem.
919    
920    2007-01-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
921    
922            * R/: Changes due to Kurt's review.
923    
924    2006-12-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
925    
926            * R/: Implemented improvements based upon comments by David
927            Meyer.
928    
929    2006-12-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
930    
931            * inst/doc/: Rewrote vignette.
932    
933            * man/: Improved documentation.
934    
935    2006-12-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
936    
937            * man/: Updated documentation.
938    
939            * DESCRIPTION: Changed package name to "tm". Updated version to
940            0.1 for first CRAN release.
941    
942            * inst/texts/gmane.comp.lang.r.general.mbox: mbox Gmane R mailing
943            list archive example.
944    
945            * inst/texts/gmane.comp.lang.r.gr.rdf: RSS Gmane R mailing list
946            archive example.
947    
948            * R/preprocess.R (convert_mbox_eml): A simple e-mail converter
949            from (several mails per box) mbox format to (single mail per file)
950            eml format.
951    
952    2006-12-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
953    
954            * data/crude.rda: Rebuilt.
955    
956            * data/acq.rda: Rebuilt.
957    
958            * R/reader.R: Factored out reader and parser methods from
959            textdoccol.R.
960    
961            * R/source.R: Factored out Source methods from aobjects.R and
962            textdoccol.R.
963            (GmaneRSource): Encapsulates Gmane R mailing list archive RSS
964            feeds.
965    
966            * R/textdoccol.R (DirSource): Added support for recursive
967            traversal of directories.
968    
969    2006-12-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
970    
971            * R/textdoccol.R ([[): Loads the document corpus automatically
972            into memory upon access.
973            (tm_transform, tm_filter): Removed several checks whether the
974            document is already loaded ([[ ensures this now).
975            (gmane_r_reader): Reader for RSS feeds as provided by the Gmane R
976            mailing list archive.
977    
978    2006-12-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
979    
980            * R/aobjects.R (TextDocument): Is now a virtual class.
981            (Source): Is now a virtual class.
982    
983    2006-12-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
984    
985            * R/textdoccol.R (c): Support for an arbitrary number of document
986            collections.
987    
988    2006-11-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
989    
990            * R/textrepo.R: Updated TextRepository (constructor), append_elem,
991            append_meta and remove_meta.
992    
993            * R/textdoccol.R: Removed modify_metadata method.
994    
995            * R/textrepo.R: Removed modify_metadata method.
996    
997            * R/textdoccol.R (remove_meta): Supports removal of document
998            collection metadata and document (= in data frame) metadata.
999    
1000    2006-11-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1001    
1002            * R/textdoccol.R (append_doc): Bug fix for handling empty metadata.
1003    
1004            * data/crude.rda: Rebuilt.
1005    
1006            * data/acq.rda: Rebuilt.
1007    
1008            * inst/doc/textmin.Rnw: Updated vignette to reflect code changes.
1009    
1010            * R/textdoccol.R ([): Bug fix for subsetting a document
1011            collection's data frame.
1012    
1013    2006-11-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1014    
1015            * R/textdoccol.R: Bug fixes in s_filter. Added full query support
1016            to s_filter.
1017    
1018            * R/textdoccol.R: Local text documents' metadata can now be copied
1019            to a document collection's data frame with prescind_meta.
1020    
1021    2006-11-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1022    
1023            * R/: Text documents' slot metadata is now accessible in s_filter.
1024    
1025            * R/: Rewrote s_filter function (has still some restrictions).
1026    
1027    2006-11-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1028    
1029            * R/: Various fixes in handling metadata.
1030    
1031            * R/: Added update mechanism for text document collections.
1032    
1033    2006-11-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1034    
1035            * R/: Merging of document collections now creates a binary tree
1036            for reconstructing merged document collections.
1037    
1038            * R/: Redesign of metadata for document collections.
1039    
1040    2006-11-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1041    
1042            * R/: Messages now use \code{ngettext}.
1043    
1044    2006-11-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1045    
1046            * R/: Added functions for modifying and removing metadata.
1047    
1048    2006-11-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1049    
1050            * man/: Updated some documentation.
1051    
1052            * R/: Corrected some connection issues.
1053    
1054            * inst/doc: Worked on the vignette.
1055    
1056    2006-10-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1057    
1058            * inst/: Added texts and started vignette.
1059    
1060            * R/: Final changes based upon David's comments.
1061    
1062    2006-10-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1063    
1064            * NAMESPACE: Corrected exports (generic methods need exportMethods
1065            directives!).
1066    
1067    2006-10-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1068    
1069            * R/: Modified the TextDocCol constructur and various parsers. It
1070            is now modular and supports various file formats via plugins (see
1071            the new "Source" class).
1072    
1073    2006-10-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1074    
1075            * man/: Revised documentation after previous code changes.
1076    
1077    2006-10-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1078    
1079            * R/: Remaining changes as discussed with David.
1080    
1081    2006-10-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1082    
1083            * R/: Some changes as suggested by David. The rest will follow
1084            within the next days.
1085    
1086  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
1087    
1088          * man/: Finished documentation.          * man/: Finished documentation.

Legend:
Removed from v.59  
changed lines
  Added in v.1200

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge