SCM

SCM Repository

[tm] Diff of /pkg/ChangeLog
ViewVC logotype

Diff of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/tm/ChangeLog revision 788, Sun Oct 14 12:16:26 2007 UTC pkg/ChangeLog revision 1167, Fri Dec 23 09:44:33 2011 UTC
# Line 1  Line 1 
1    2011-12-23  Ingo Feinerer  <feinerer@logic.at>
2    
3            * R/matrix.R (termFreq): Fix invalid handling of
4            control$wordLengths[1]. Reported by Steven C. Bagley.
5    
6    2011-12-17  Ingo Feinerer  <feinerer@logic.at>
7    
8            * DESCRIPTION (Version): Prepare for CRAN Christmas release.
9    
10    2011-12-12  Ingo Feinerer  <feinerer@logic.at>
11    
12            * R/utils.R (map_IETF_Snowball): Map empty input to "porter".
13    
14    2011-12-07  Ingo Feinerer  <feinerer@logic.at>
15    
16            * R/transform.R (removePunctuation): Add option to preserve
17            intra-word dashes.
18    
19    2011-12-06  Ingo Feinerer  <feinerer@logic.at>
20    
21            * R/matrix.R (termFreq): Allow reordering of control option
22            processing.
23    
24    2011-11-17  Ingo Feinerer  <feinerer@logic.at>
25    
26            * R/reader.R (readPDF): Use tools:::pdf_info() instead of external
27            pdfinfo tool.
28    
29            * inst/stopwords/SMART.dat: Add SMART information retrieval system
30            stopwords (which are also used by the MC toolkit).
31    
32            * R/matrix (termFreq): Allow local option \code{bounds$local} to
33            restrict how often a term may appear in each document (generalizes
34            \code{minDocFreq}). Similarly the local option \code{wordLenghts}
35            for word length bounds (generalizes \code{minWordLength}).
36    
37            * R/matrix.R (TermDocumentMatrix.VCorpus): New global option
38            \code{bounds$global} for restricting how often a term is allowed
39            to appear in different documents.
40    
41            * R/matrix.R (TermDocumentMatrix.VCorpus): Distinguish between
42            local options delegated internally to termFreq() and global
43            options which are processed by the term-document matrix
44            constructor itself.
45    
46    2011-11-15  Ingo Feinerer  <feinerer@logic.at>
47    
48            * man/getTokenizers.Rd: Document getTokenizers().
49    
50            * man/tokenizer.Rd: Document MC_tokenizer() and scan_tokenizer().
51    
52    2011-11-04  Ingo Feinerer  <feinerer@logic.at>
53    
54            * man/matrix.Rd: Document as.TermDocumentMatrix.term_frequency.
55    
56            * man/combine.Rd: Document c.term_frequency().
57    
58    2011-10-11  Ingo Feinerer  <feinerer@logic.at>
59    
60            * R/meta.R (`meta<-.Corpus`): Assume that the replacement value
61            can be accessed via '[' and not '[['.
62    
63    2011-08-24  Ingo Feinerer  <feinerer@logic.at>
64    
65            * R/stopwords.R (stopwords): Raise an error if no stopwords are
66            available for requested language. Suggested by Derek M Jones.
67    
68    2011-05-27  Ingo Feinerer  <feinerer@logic.at>
69    
70            * R/weight.R (weightSMART): Implement Cosine and pivoted unique
71            normalization.
72    
73    2011-02-17  Ingo Feinerer  <feinerer@logic.at>
74    
75            * R/transform.R (stemDocument.PlainTextDocument): Use language
76            argument.
77    
78    2011-02-04  Ingo Feinerer  <feinerer@logic.at>
79    
80            * R/source.R: Store strings and connections instead of unevaluated
81            calls.
82    
83    2010-11-26  Ingo Feinerer  <feinerer@logic.at>
84    
85            * R/corpus.R (Corpus): Allow init and exit hooks for readers.
86    
87    2010-10-22  Ingo Feinerer  <feinerer@logic.at>
88    
89            * R/matrix.R (.TermDocumentMatrix): Make Weighting an attribute
90            (instead of a list element).
91    
92    2010-10-16  Ingo Feinerer  <feinerer@logic.at>
93    
94            * R/corpus.R (`[[.VCorpus`, `[[.PCorpus'): Access individual
95            documents by names (fallback to IDs if names are not set).
96    
97    2010-08-25  Ingo Feinerer  <feinerer@logic.at>
98    
99            * R/corpus.R (c.Corpus): When concatenating corpora, the argument
100            \code{recursive} now determines whether existing corpus meta data
101            is used.
102    
103    2010-08-06  Ingo Feinerer  <feinerer@logic.at>
104    
105            * R/transform.R: Removed convert_UTF_8(). Use enc2utf8() instead.
106    
107    2010-06-17  Ingo Feinerer  <feinerer@logic.at>
108    
109            * R/matrix.R (TermDocumentMatrix): If a dictionary is given do not
110            remove terms not occurring in the corpus anymore.
111    
112    2010-06-02  Ingo Feinerer  <feinerer@logic.at>
113    
114            * R/plot.R (Zipf_plot, Heaps_plot): Plotting functions for Zipf's
115            and Heaps' law.
116    
117    2010-05-18  Ingo Feinerer  <feinerer@logic.at>
118    
119            * R/corpus.R (Corpus, PCorpus): Use element names as IDs if
120            provided by a source.
121    
122    2010-04-09  Ingo Feinerer  <feinerer@logic.at>
123    
124            * R/source.R (.Source): Provide document names.
125    
126    2010-04-07  Ingo Feinerer  <feinerer@logic.at>
127    
128            * R/meta.R (`content_or_meta`): Utility function.
129    
130    2010-03-19  Ingo Feinerer  <feinerer@logic.at>
131    
132            * R/reader.R (readReut21578XML, readReut21578XMLasPlain): Extract
133            TOPICS, LEWISSPLIT, CGISPLIT, and OLDID meta tags.
134    
135    2010-03-03  Ingo Feinerer  <feinerer@logic.at>
136    
137            * R/weight.R (weightTfIdf): Added normalization option.
138    
139            * man/tm_tag_score.Rd: Add General Inquirer example for sentiment
140            analysis.
141    
142    2010-02-25  Ingo Feinerer  <feinerer@logic.at>
143    
144            * R/score.R (tm_tag_score): Compute a score from the number of
145            tags matching in a document.
146    
147    2010-02-18  Ingo Feinerer  <feinerer@logic.at>
148    
149            * R/complete.R (stemCompletion): New completion heuristics.
150    
151    2010-02-17  Ingo Feinerer  <feinerer@logic.at>
152    
153            * R/plot.R (plot.TermDocumentMatrix): Memory improvements.
154    
155    2010-02-06  Ingo Feinerer  <feinerer@logic.at>
156    
157            * DESCRIPTION (Depends): Depend on R (>= 2.10.0) to ensure that
158            setOldClass(c(..., "list")) works.
159    
160    2010-01-22  Ingo Feinerer  <feinerer@logic.at>
161    
162            * R/transform.R (stemDocument.character): In case input is a
163            simple character just delegate to the default Snowball stemmer.
164    
165    2010-01-15  Ingo Feinerer  <feinerer@logic.at>
166    
167            * R/reader.R (readReut21578XML, readRCV1): Extract more meta
168            data.
169    
170    2010-01-12  Ingo Feinerer  <feinerer@logic.at>
171    
172            * R/doc.R (`Content<-`): Be careful with names attribute.
173    
174    2010-01-07  Stefan Theussl  <stefan.theussl@wu.ac.at>
175    
176            * R/source.R (DirSource): Improved implementation especially when
177            handling many (> 1M) files.
178    
179    2009-12-22  Ingo Feinerer  <feinerer@logic.at>
180    
181            * R/source.R (getElem.URISource): Use encoding argument.
182    
183    2009-12-11  Ingo Feinerer  <feinerer@logic.at>
184    
185            * R/doc.R (setOldClass): Register S3 document classes to be
186            recognized by S4 methods.
187    
188    2009-11-25  Ingo Feinerer  <feinerer@logic.at>
189    
190            * R/matrix.R (termFreq): Add option to remove punctuation
191            characters.
192    
193    2009-11-19  Ingo Feinerer  <feinerer@logic.at>
194    
195            * R/matrix.R (c.TermDocumentMatrix): Added combine method for
196            merging multiple term-document matrices.
197    
198    2009-11-17  Ingo Feinerer  <feinerer@logic.at>
199    
200            * R/corpus.R (setOldClass): Register S3 corpus classes to be
201            recognized by S4 methods.
202    
203            * man/plot.Rd: Use \dontrun{} in \examples{} section in the hope
204            that CRAN Mac OS X builds do not fail any longer.
205    
206    2009-11-15  Ingo Feinerer  <feinerer@logic.at>
207    
208            * R/matrix.R (tokenize): Use scan(..., what = "character") instead
209            of RWeka:AlphabeticTokenizer() as default.
210    
211    2009-11-14  Ingo Feinerer  <feinerer@logic.at>
212    
213            * R/transform.R (removeWords.PlainTextDocument): Fix bug which
214            caused words at the beginning or the end of a line not to be removed. Do
215            not delete whitespace anymore.
216    
217    2009-11-12  Ingo Feinerer  <feinerer@logic.at>
218    
219            * R/source.R (DirSource): Default to working directory if no path
220            is specified.
221    
222    2009-11-11  Ingo Feinerer  <feinerer@logic.at>
223    
224            * R/source.R (DirSource): Stop on empty directories.
225    
226    2009-11-07  Ingo Feinerer  <feinerer@logic.at>
227    
228            * R/matrix.R (TermDocumentMatrix): Avoid prefixes originating from
229            named documents.
230    
231    2009-10-21  Ingo Feinerer  <feinerer@logic.at>
232    
233            * R/transform.R (removeWords): Improve regular expressions.
234    
235    2009-10-19  Ingo Feinerer  <feinerer@logic.at>
236    
237            * R/meta.R (DublinCore): Allow lower case tags.
238    
239    2009-10-09  Ingo Feinerer  <feinerer@logic.at>
240    
241            * R/source.R (GmaneSource, ReutersSource): Use xmlChildren(x)
242            instead of x$children.
243    
244    2009-09-15  Ingo Feinerer  <feinerer@logic.at>
245    
246            * R/preprocess.R (preprocessReut21578XML): Fix generated file names.
247    
248    2009-09-06  Ingo Feinerer  <feinerer@logic.at>
249    
250            * R/: Use S3 instead of S4 class system.
251    
252    2009-08-11  Ingo Feinerer  <feinerer@logic.at>
253    
254            * R/reader.R (readMail): Moved to tm.plugin.mail package.
255    
256    2009-07-04  Ingo Feinerer  <feinerer@logic.at>
257    
258            * R/reader.R (readNewsgroup): Rename to readMail as newsgroup
259            postings are basically e-mails with some extra headers.
260    
261    2009-07-03  Ingo Feinerer  <feinerer@logic.at>
262    
263            * R/transform.R: Move convertMboxEml, removeCitation,
264            removeMultipart, and removeSignature to the tm.plugin.mail package
265            since they are mainly utility functions (for handling e-mails) and
266            not very framework specific.
267    
268    2009-06-28  Ingo Feinerer  <feinerer@logic.at>
269    
270            * man/: Fix documentation.
271    
272    2009-06-26  Ingo Feinerer  <feinerer@logic.at>
273    
274            * R/reader.R (readReut21578XMLasPlain): New reader which returns a
275            plain text document instead of an XML document for texts of the
276            Reuters-21578 dataset.
277    
278            * R/sparse.R: Removed since the slam package is now available on
279            CRAN.
280    
281            * DESCRIPTION (Depends): Add slam package.
282    
283    2009-06-17  Ingo Feinerer  <feinerer@logic.at>
284    
285            * R/transform.R (stemDoc): Fix character(0) handling.
286    
287    2009-06-12  Ingo Feinerer  <feinerer@logic.at>
288    
289            * R/doc.R (show): Pretty print.
290    
291    2009-05-27  Ingo Feinerer  <feinerer@logic.at>
292    
293            * R/matrix.R (print.TermDocumentMatrix): Handle empty matrices
294            gracefully.
295    
296    2009-05-13  Ingo Feinerer  <feinerer@logic.at>
297    
298            * R/corpus.R: Make corpus virtual. Implement corpus with standard
299            and permanent storage semantics.
300    
301            * DESCRIPTION: New major release. A *lot* of improvements.
302    
303    2009-05-04   Ingo Feinerer <feinerer@logic.at>
304    
305            * NAMESPACE: Export some simple_triplet_matrix functions.
306    
307    2009-04-28   Ingo Feinerer <feinerer@logic.at>
308    
309            * R/weight.R: Adapt tf-idf to new matrix format.
310    
311    2009-04-27  Ingo Feinerer  <feinerer@logic.at>
312    
313            * R/matrix.R: Create two distinct classes for term-document and
314            document-term matrices.
315    
316    2009-04-26  Ingo Feinerer  <feinerer@logic.at>
317    
318            * R/termdocmatrix.R: No longer use Matrix package. This reduces
319            package start-up time significantly.
320    
321    2009-04-11  Ingo Feinerer  <feinerer@logic.at>
322    
323            * inst/doc/tm.Rnw: Fix code/documentation mismatch.
324    
325    2009-04-04  Ingo Feinerer  <feinerer@logic.at>
326    
327            * R/transform.R (tmReduce): Combine multiple maps into one
328            transformation.
329    
330    2009-04-03  Ingo Feinerer  <feinerer@logic.at>
331    
332            * R/weight.R: Remove weightLogical since it does not return a
333            dgCMatrix.
334    
335            * R/termdocmatrix.R: Removed TermDocMatrix. Use DocumentTermMatrix
336            or TermDocumentMatrix instead.
337    
338    2009-03-28  Ingo Feinerer  <feinerer@logic.at>
339    
340            * inst/doc/extensions.Rnw: Finished vignette.
341    
342    2009-03-27  Ingo Feinerer  <feinerer@logic.at>
343    
344            * R/termdocmatrix.R: Start to work on new TermDocumentMatrix and
345            DocumentTermMatrix representations.
346    
347    2009-03-23  Ingo Feinerer  <feinerer@logic.at>
348    
349            * R/reader.R (readXML): New reader for arbitrary XML files.
350    
351    2009-03-22  Ingo Feinerer  <feinerer@logic.at>
352    
353            * R/source.R (CSVSource): Defunct (use DataframeSource instead).
354            (XMLSource): New XMLSource class for arbitrary XML files.
355            (Source): New slot Vectorized.
356    
357    2009-03-21  Ingo Feinerer  <feinerer@logic.at>
358    
359            * R/reader.R (readTabular): Experimental reader for tabular data
360            structures which can be customized via user-defined mappings.
361    
362            * R/reader.R: Always use UTC time zone.
363    
364            * R/AAA.R (.onLoad): No longer try to start a MPI cluster.
365    
366    2009-03-20  Ingo Feinerer  <feinerer@logic.at>
367    
368            * R/reader.R (readDOC): Options can be passed over to antiword.
369    
370            * R/reader.R (readPDF): Options can be passed over to pdfinfo and
371            pdftotext.
372    
373    2009-03-10  Ingo Feinerer  <feinerer@logic.at>
374    
375            * R/source.R (DirSource): Add pattern and ignore.case arguments
376            which are internally passed over to list.files().
377    
378    2009-03-02  Ingo Feinerer  <feinerer@logic.at>
379    
380            * inst/doc/tm.Rnw: Suppress pointless loading message.
381    
382    2009-01-29  Ingo Feinerer  <feinerer@logic.at>
383    
384            * DESCRIPTION: Speed up package loading (via moving packages not
385            strictly necessary for normal operation to Suggests instead of
386            Depends).
387    
388    2009-01-08  Ingo Feinerer  <feinerer@logic.at>
389    
390            * R/reader.R (readNewsgroup): The date format is now configurable.
391    
392    2008-12-20  Ingo Feinerer  <feinerer@logic.at>
393    
394            * R/preprocess.R (convertMboxEml): Fix off-by-one error.
395    
396    2008-12-16  Ingo Feinerer  <feinerer@logic.at>
397    
398            * R/termdocmatrix.R (TermDocMatrix): Sort row indices.
399    
400    2008-12-06  Ingo Feinerer  <feinerer@logic.at>
401    
402            * R/source.R (DataframeSource): New source class for data frames.
403    
404            * R/source.R: Fixed non-standard call evaluation.
405    
406    2008-11-29  Ingo Feinerer  <feinerer@logic.at>
407    
408            * R/source.R (URISource): New source class for a single document.
409    
410    2008-11-27  Ingo Feinerer  <feinerer@logic.at>
411    
412            * R/source.R: Refactoring.
413    
414    2008-11-25  Ingo Feinerer  <feinerer@logic.at>
415    
416            * R/AAA.R (.onLoad, .Last): Use tryCatch() to handle misconfigured
417            Rmpi installations more gracefully.
418    
419    2008-11-08  Ingo Feinerer  <feinerer@logic.at>
420    
421            * R/source.R (Source): Add Length slot.
422    
423    2008-11-06  Ingo Feinerer  <feinerer@logic.at>
424    
425            * R/AAA.R: Unify duplicated .onLoad function.
426    
427    2008-11-03  Ingo Feinerer  <feinerer@logic.at>
428    
429            * DESCRIPTION (Suggests): Added Rmpi.
430    
431    2008-11-02  Ingo Feinerer  <feinerer@logic.at>
432    
433            * R/source.R (getElem): Fix 'no visible binding' warning.
434    
435            * man/WeightFunction.Rd: Fix signature.
436    
437    2008-08-03  Ingo Feinerer  <feinerer@logic.at>
438    
439            * R/weight.R: Introduce name abbreviations for weighting functions.
440    
441    2008-07-24  Ingo Feinerer  <feinerer@logic.at>
442    
443            * R/AAA.R (.onLoad, .Last): Start and stop MPI cluster.
444    
445            * R/cluster.R: Provide convenience functions for using a MPI
446            cluster.
447    
448            * R/termdocmatrix.R (TermDocMatrix): Use MPI cluster if
449            available.
450    
451            * R/textdoccol.R (tmIndex, tmFilter, tmMap): Use MPI cluster if
452            available.
453    
454    2008-07-17  Ingo Feinerer  <feinerer@logic.at>
455    
456            * R/textdoccol.R (lapply): Removed debug print out.
457    
458    2008-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
459    
460            * R/reader.R (readRCV1): Improved meta data extraction from
461            Reuters Corpus Volume 1 documents.
462    
463    2008-05-25  Ingo Feinerer  <h0125130@wu-wien.ac.at>
464    
465            * R/transform.R: Ensure that all mappings preserve multiline
466            structures.
467    
468    2008-05-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
469    
470            * R/filter.R: Every filter has now an attribute indicating whether
471            it sould be applied to document level (doclevel).
472    
473            * R/textdoccol.R (tmFilter): Set searchFullText as new default
474            filter.
475    
476    2008-04-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
477    
478            * R/transform.R (replacePatterns): Replaced removeWords by
479            replacePatterns. Suggested by Christian Buchta.
480    
481            * R/textdoccol.R (inspect): Improved formatting.
482    
483    2008-04-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
484    
485            * inst/CITATION: Updated JSS article information.
486    
487            * R/textdoccol.R (setAs): Added coerce method from list to
488            corpus.
489    
490            * R/meta.R (meta): Improved meta data handling.
491    
492    2008-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
493    
494            * R/textdoccol.R (materialize, tmMap): Improvements suggested by
495            Christian Buchta.
496    
497            * inst/CITATION: Added template to include JSS article reference.
498    
499    2008-03-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
500    
501            * R/textdoccol.R (tmMap): Introduced lazy mapping.
502    
503            * R/source.R: Added VectorSource.
504    
505    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
506    
507            * man/: Language codes should be in ISO 639-1 format.
508    
509            * R/textdoccol.R (asPlain): Preserve local meta data.
510    
511    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
512    
513            * R/textdoccol.R (writeCorpus): Function for writing a corpus
514            containing plain text documents to disk.
515    
516    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
517    
518            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
519            always set correctly.
520    
521            * R/textdoccol.R: Set load = TRUE as default for load on demand
522            since in most cases this is the wanted behaviour.
523    
524    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
525    
526            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
527    
528            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
529    
530    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
531    
532            * R/meta.R (meta): New function for consistent access to meta data
533            of document collections, repositories, and texts.
534    
535    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
536    
537            * R/: Better support for encodings.
538    
539    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
540    
541            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
542            selection when no reader argument is given.
543    
544    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
545    
546            * R/source.R (CSVSource): Now uses read.csv instead of scan
547            internally.
548    
549    2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
550    
551            * R/reader.R (getReaders): Returns available reader functions.
552    
553            * R/termdocmatrix.R (TermDocMatrix): Set new modular constructor
554            as default.
555    
556    2007-12-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
557    
558            * R/stopwords.R (stopwords): Shortened code, removed codetools
559            variable warnings.
560    
561            * man/: Documentation for showMeta, added an example for tmMap.
562    
563            * inst/doc/tm.Rnw: Updated vignette, comments on MS word reader,
564            some minor typos fixed.
565    
566    2007-12-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
567    
568            * R/aobjects.R (showMeta): Added method for pretty printing a
569            text document's meta data.
570    
571    2007-11-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
572    
573            * R/textdoccol.R (TextDocCol): Better handling of empty
574            arguments.
575    
576            * NAMESPACE: Exported readDOC.
577    
578            * man/completeStems.Rd: Added an example.
579    
580    2007-11-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
581    
582            * R/stopwords.R (stopwords): Look up .dat files at every
583            call. Allows users to modify stopword .dat files interactively.
584    
585    2007-11-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
586    
587            * R/termdocmatrix.R (termFreq): Correct processing of empty
588            documents.
589    
590    2007-10-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
591    
592            * man/: Updated documentation.
593    
594    2007-10-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
595    
596            * R/complete.R (completeStems): Completes (heuristically) word
597            stems.
598    
599            * R/termdocmatrix.R (TermDocMatrix2): New modular
600            constructor.
601    
602            * NAMESPACE: Exported termFreq.
603    
604    2007-10-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
605    
606            * R/reader.R (readDOC): Added MS Word reader (using antiword).
607    
608  2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
609    
610          * R/weight.R: Weighting functions for TermDocMatrix.          * R/weight.R: Weighting functions for TermDocMatrix.

Legend:
Removed from v.788  
changed lines
  Added in v.1167

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge