SCM

SCM Repository

[tm] Diff of /pkg/ChangeLog
ViewVC logotype

Diff of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/tm/ChangeLog revision 806, Wed Jan 2 10:29:14 2008 UTC pkg/ChangeLog revision 1164, Mon Dec 12 06:42:28 2011 UTC
# Line 1  Line 1 
1    2011-12-12  Ingo Feinerer  <feinerer@logic.at>
2    
3            * R/utils.R (map_IETF_Snowball): Map empty input to "porter".
4    
5    2011-12-07  Ingo Feinerer  <feinerer@logic.at>
6    
7            * R/transform.R (removePunctuation): Add option to preserve
8            intra-word dashes.
9    
10    2011-12-06  Ingo Feinerer  <feinerer@logic.at>
11    
12            * R/matrix.R (termFreq): Allow reordering of control option
13            processing.
14    
15    2011-11-17  Ingo Feinerer  <feinerer@logic.at>
16    
17            * R/reader.R (readPDF): Use tools:::pdf_info() instead of external
18            pdfinfo tool.
19    
20            * inst/stopwords/SMART.dat: Add SMART information retrieval system
21            stopwords (which are also used by the MC toolkit).
22    
23            * R/matrix (termFreq): Allow local option \code{bounds$local} to
24            restrict how often a term may appear in each document (generalizes
25            \code{minDocFreq}). Similarly the local option \code{wordLenghts}
26            for word length bounds (generalizes \code{minWordLength}).
27    
28            * R/matrix.R (TermDocumentMatrix.VCorpus): New global option
29            \code{bounds$global} for restricting how often a term is allowed
30            to appear in different documents.
31    
32            * R/matrix.R (TermDocumentMatrix.VCorpus): Distinguish between
33            local options delegated internally to termFreq() and global
34            options which are processed by the term-document matrix
35            constructor itself.
36    
37    2011-11-15  Ingo Feinerer  <feinerer@logic.at>
38    
39            * man/getTokenizers.Rd: Document getTokenizers().
40    
41            * man/tokenizer.Rd: Document MC_tokenizer() and scan_tokenizer().
42    
43    2011-11-04  Ingo Feinerer  <feinerer@logic.at>
44    
45            * man/matrix.Rd: Document as.TermDocumentMatrix.term_frequency.
46    
47            * man/combine.Rd: Document c.term_frequency().
48    
49    2011-10-11  Ingo Feinerer  <feinerer@logic.at>
50    
51            * R/meta.R (`meta<-.Corpus`): Assume that the replacement value
52            can be accessed via '[' and not '[['.
53    
54    2011-08-24  Ingo Feinerer  <feinerer@logic.at>
55    
56            * R/stopwords.R (stopwords): Raise an error if no stopwords are
57            available for requested language. Suggested by Derek M Jones.
58    
59    2011-05-27  Ingo Feinerer  <feinerer@logic.at>
60    
61            * R/weight.R (weightSMART): Implement Cosine and pivoted unique
62            normalization.
63    
64    2011-02-17  Ingo Feinerer  <feinerer@logic.at>
65    
66            * R/transform.R (stemDocument.PlainTextDocument): Use language
67            argument.
68    
69    2011-02-04  Ingo Feinerer  <feinerer@logic.at>
70    
71            * R/source.R: Store strings and connections instead of unevaluated
72            calls.
73    
74    2010-11-26  Ingo Feinerer  <feinerer@logic.at>
75    
76            * R/corpus.R (Corpus): Allow init and exit hooks for readers.
77    
78    2010-10-22  Ingo Feinerer  <feinerer@logic.at>
79    
80            * R/matrix.R (.TermDocumentMatrix): Make Weighting an attribute
81            (instead of a list element).
82    
83    2010-10-16  Ingo Feinerer  <feinerer@logic.at>
84    
85            * R/corpus.R (`[[.VCorpus`, `[[.PCorpus'): Access individual
86            documents by names (fallback to IDs if names are not set).
87    
88    2010-08-25  Ingo Feinerer  <feinerer@logic.at>
89    
90            * R/corpus.R (c.Corpus): When concatenating corpora, the argument
91            \code{recursive} now determines whether existing corpus meta data
92            is used.
93    
94    2010-08-06  Ingo Feinerer  <feinerer@logic.at>
95    
96            * R/transform.R: Removed convert_UTF_8(). Use enc2utf8() instead.
97    
98    2010-06-17  Ingo Feinerer  <feinerer@logic.at>
99    
100            * R/matrix.R (TermDocumentMatrix): If a dictionary is given do not
101            remove terms not occurring in the corpus anymore.
102    
103    2010-06-02  Ingo Feinerer  <feinerer@logic.at>
104    
105            * R/plot.R (Zipf_plot, Heaps_plot): Plotting functions for Zipf's
106            and Heaps' law.
107    
108    2010-05-18  Ingo Feinerer  <feinerer@logic.at>
109    
110            * R/corpus.R (Corpus, PCorpus): Use element names as IDs if
111            provided by a source.
112    
113    2010-04-09  Ingo Feinerer  <feinerer@logic.at>
114    
115            * R/source.R (.Source): Provide document names.
116    
117    2010-04-07  Ingo Feinerer  <feinerer@logic.at>
118    
119            * R/meta.R (`content_or_meta`): Utility function.
120    
121    2010-03-19  Ingo Feinerer  <feinerer@logic.at>
122    
123            * R/reader.R (readReut21578XML, readReut21578XMLasPlain): Extract
124            TOPICS, LEWISSPLIT, CGISPLIT, and OLDID meta tags.
125    
126    2010-03-03  Ingo Feinerer  <feinerer@logic.at>
127    
128            * R/weight.R (weightTfIdf): Added normalization option.
129    
130            * man/tm_tag_score.Rd: Add General Inquirer example for sentiment
131            analysis.
132    
133    2010-02-25  Ingo Feinerer  <feinerer@logic.at>
134    
135            * R/score.R (tm_tag_score): Compute a score from the number of
136            tags matching in a document.
137    
138    2010-02-18  Ingo Feinerer  <feinerer@logic.at>
139    
140            * R/complete.R (stemCompletion): New completion heuristics.
141    
142    2010-02-17  Ingo Feinerer  <feinerer@logic.at>
143    
144            * R/plot.R (plot.TermDocumentMatrix): Memory improvements.
145    
146    2010-02-06  Ingo Feinerer  <feinerer@logic.at>
147    
148            * DESCRIPTION (Depends): Depend on R (>= 2.10.0) to ensure that
149            setOldClass(c(..., "list")) works.
150    
151    2010-01-22  Ingo Feinerer  <feinerer@logic.at>
152    
153            * R/transform.R (stemDocument.character): In case input is a
154            simple character just delegate to the default Snowball stemmer.
155    
156    2010-01-15  Ingo Feinerer  <feinerer@logic.at>
157    
158            * R/reader.R (readReut21578XML, readRCV1): Extract more meta
159            data.
160    
161    2010-01-12  Ingo Feinerer  <feinerer@logic.at>
162    
163            * R/doc.R (`Content<-`): Be careful with names attribute.
164    
165    2010-01-07  Stefan Theussl  <stefan.theussl@wu.ac.at>
166    
167            * R/source.R (DirSource): Improved implementation especially when
168            handling many (> 1M) files.
169    
170    2009-12-22  Ingo Feinerer  <feinerer@logic.at>
171    
172            * R/source.R (getElem.URISource): Use encoding argument.
173    
174    2009-12-11  Ingo Feinerer  <feinerer@logic.at>
175    
176            * R/doc.R (setOldClass): Register S3 document classes to be
177            recognized by S4 methods.
178    
179    2009-11-25  Ingo Feinerer  <feinerer@logic.at>
180    
181            * R/matrix.R (termFreq): Add option to remove punctuation
182            characters.
183    
184    2009-11-19  Ingo Feinerer  <feinerer@logic.at>
185    
186            * R/matrix.R (c.TermDocumentMatrix): Added combine method for
187            merging multiple term-document matrices.
188    
189    2009-11-17  Ingo Feinerer  <feinerer@logic.at>
190    
191            * R/corpus.R (setOldClass): Register S3 corpus classes to be
192            recognized by S4 methods.
193    
194            * man/plot.Rd: Use \dontrun{} in \examples{} section in the hope
195            that CRAN Mac OS X builds do not fail any longer.
196    
197    2009-11-15  Ingo Feinerer  <feinerer@logic.at>
198    
199            * R/matrix.R (tokenize): Use scan(..., what = "character") instead
200            of RWeka:AlphabeticTokenizer() as default.
201    
202    2009-11-14  Ingo Feinerer  <feinerer@logic.at>
203    
204            * R/transform.R (removeWords.PlainTextDocument): Fix bug which
205            caused words at the beginning or the end of a line not to be removed. Do
206            not delete whitespace anymore.
207    
208    2009-11-12  Ingo Feinerer  <feinerer@logic.at>
209    
210            * R/source.R (DirSource): Default to working directory if no path
211            is specified.
212    
213    2009-11-11  Ingo Feinerer  <feinerer@logic.at>
214    
215            * R/source.R (DirSource): Stop on empty directories.
216    
217    2009-11-07  Ingo Feinerer  <feinerer@logic.at>
218    
219            * R/matrix.R (TermDocumentMatrix): Avoid prefixes originating from
220            named documents.
221    
222    2009-10-21  Ingo Feinerer  <feinerer@logic.at>
223    
224            * R/transform.R (removeWords): Improve regular expressions.
225    
226    2009-10-19  Ingo Feinerer  <feinerer@logic.at>
227    
228            * R/meta.R (DublinCore): Allow lower case tags.
229    
230    2009-10-09  Ingo Feinerer  <feinerer@logic.at>
231    
232            * R/source.R (GmaneSource, ReutersSource): Use xmlChildren(x)
233            instead of x$children.
234    
235    2009-09-15  Ingo Feinerer  <feinerer@logic.at>
236    
237            * R/preprocess.R (preprocessReut21578XML): Fix generated file names.
238    
239    2009-09-06  Ingo Feinerer  <feinerer@logic.at>
240    
241            * R/: Use S3 instead of S4 class system.
242    
243    2009-08-11  Ingo Feinerer  <feinerer@logic.at>
244    
245            * R/reader.R (readMail): Moved to tm.plugin.mail package.
246    
247    2009-07-04  Ingo Feinerer  <feinerer@logic.at>
248    
249            * R/reader.R (readNewsgroup): Rename to readMail as newsgroup
250            postings are basically e-mails with some extra headers.
251    
252    2009-07-03  Ingo Feinerer  <feinerer@logic.at>
253    
254            * R/transform.R: Move convertMboxEml, removeCitation,
255            removeMultipart, and removeSignature to the tm.plugin.mail package
256            since they are mainly utility functions (for handling e-mails) and
257            not very framework specific.
258    
259    2009-06-28  Ingo Feinerer  <feinerer@logic.at>
260    
261            * man/: Fix documentation.
262    
263    2009-06-26  Ingo Feinerer  <feinerer@logic.at>
264    
265            * R/reader.R (readReut21578XMLasPlain): New reader which returns a
266            plain text document instead of an XML document for texts of the
267            Reuters-21578 dataset.
268    
269            * R/sparse.R: Removed since the slam package is now available on
270            CRAN.
271    
272            * DESCRIPTION (Depends): Add slam package.
273    
274    2009-06-17  Ingo Feinerer  <feinerer@logic.at>
275    
276            * R/transform.R (stemDoc): Fix character(0) handling.
277    
278    2009-06-12  Ingo Feinerer  <feinerer@logic.at>
279    
280            * R/doc.R (show): Pretty print.
281    
282    2009-05-27  Ingo Feinerer  <feinerer@logic.at>
283    
284            * R/matrix.R (print.TermDocumentMatrix): Handle empty matrices
285            gracefully.
286    
287    2009-05-13  Ingo Feinerer  <feinerer@logic.at>
288    
289            * R/corpus.R: Make corpus virtual. Implement corpus with standard
290            and permanent storage semantics.
291    
292            * DESCRIPTION: New major release. A *lot* of improvements.
293    
294    2009-05-04   Ingo Feinerer <feinerer@logic.at>
295    
296            * NAMESPACE: Export some simple_triplet_matrix functions.
297    
298    2009-04-28   Ingo Feinerer <feinerer@logic.at>
299    
300            * R/weight.R: Adapt tf-idf to new matrix format.
301    
302    2009-04-27  Ingo Feinerer  <feinerer@logic.at>
303    
304            * R/matrix.R: Create two distinct classes for term-document and
305            document-term matrices.
306    
307    2009-04-26  Ingo Feinerer  <feinerer@logic.at>
308    
309            * R/termdocmatrix.R: No longer use Matrix package. This reduces
310            package start-up time significantly.
311    
312    2009-04-11  Ingo Feinerer  <feinerer@logic.at>
313    
314            * inst/doc/tm.Rnw: Fix code/documentation mismatch.
315    
316    2009-04-04  Ingo Feinerer  <feinerer@logic.at>
317    
318            * R/transform.R (tmReduce): Combine multiple maps into one
319            transformation.
320    
321    2009-04-03  Ingo Feinerer  <feinerer@logic.at>
322    
323            * R/weight.R: Remove weightLogical since it does not return a
324            dgCMatrix.
325    
326            * R/termdocmatrix.R: Removed TermDocMatrix. Use DocumentTermMatrix
327            or TermDocumentMatrix instead.
328    
329    2009-03-28  Ingo Feinerer  <feinerer@logic.at>
330    
331            * inst/doc/extensions.Rnw: Finished vignette.
332    
333    2009-03-27  Ingo Feinerer  <feinerer@logic.at>
334    
335            * R/termdocmatrix.R: Start to work on new TermDocumentMatrix and
336            DocumentTermMatrix representations.
337    
338    2009-03-23  Ingo Feinerer  <feinerer@logic.at>
339    
340            * R/reader.R (readXML): New reader for arbitrary XML files.
341    
342    2009-03-22  Ingo Feinerer  <feinerer@logic.at>
343    
344            * R/source.R (CSVSource): Defunct (use DataframeSource instead).
345            (XMLSource): New XMLSource class for arbitrary XML files.
346            (Source): New slot Vectorized.
347    
348    2009-03-21  Ingo Feinerer  <feinerer@logic.at>
349    
350            * R/reader.R (readTabular): Experimental reader for tabular data
351            structures which can be customized via user-defined mappings.
352    
353            * R/reader.R: Always use UTC time zone.
354    
355            * R/AAA.R (.onLoad): No longer try to start a MPI cluster.
356    
357    2009-03-20  Ingo Feinerer  <feinerer@logic.at>
358    
359            * R/reader.R (readDOC): Options can be passed over to antiword.
360    
361            * R/reader.R (readPDF): Options can be passed over to pdfinfo and
362            pdftotext.
363    
364    2009-03-10  Ingo Feinerer  <feinerer@logic.at>
365    
366            * R/source.R (DirSource): Add pattern and ignore.case arguments
367            which are internally passed over to list.files().
368    
369    2009-03-02  Ingo Feinerer  <feinerer@logic.at>
370    
371            * inst/doc/tm.Rnw: Suppress pointless loading message.
372    
373    2009-01-29  Ingo Feinerer  <feinerer@logic.at>
374    
375            * DESCRIPTION: Speed up package loading (via moving packages not
376            strictly necessary for normal operation to Suggests instead of
377            Depends).
378    
379    2009-01-08  Ingo Feinerer  <feinerer@logic.at>
380    
381            * R/reader.R (readNewsgroup): The date format is now configurable.
382    
383    2008-12-20  Ingo Feinerer  <feinerer@logic.at>
384    
385            * R/preprocess.R (convertMboxEml): Fix off-by-one error.
386    
387    2008-12-16  Ingo Feinerer  <feinerer@logic.at>
388    
389            * R/termdocmatrix.R (TermDocMatrix): Sort row indices.
390    
391    2008-12-06  Ingo Feinerer  <feinerer@logic.at>
392    
393            * R/source.R (DataframeSource): New source class for data frames.
394    
395            * R/source.R: Fixed non-standard call evaluation.
396    
397    2008-11-29  Ingo Feinerer  <feinerer@logic.at>
398    
399            * R/source.R (URISource): New source class for a single document.
400    
401    2008-11-27  Ingo Feinerer  <feinerer@logic.at>
402    
403            * R/source.R: Refactoring.
404    
405    2008-11-25  Ingo Feinerer  <feinerer@logic.at>
406    
407            * R/AAA.R (.onLoad, .Last): Use tryCatch() to handle misconfigured
408            Rmpi installations more gracefully.
409    
410    2008-11-08  Ingo Feinerer  <feinerer@logic.at>
411    
412            * R/source.R (Source): Add Length slot.
413    
414    2008-11-06  Ingo Feinerer  <feinerer@logic.at>
415    
416            * R/AAA.R: Unify duplicated .onLoad function.
417    
418    2008-11-03  Ingo Feinerer  <feinerer@logic.at>
419    
420            * DESCRIPTION (Suggests): Added Rmpi.
421    
422    2008-11-02  Ingo Feinerer  <feinerer@logic.at>
423    
424            * R/source.R (getElem): Fix 'no visible binding' warning.
425    
426            * man/WeightFunction.Rd: Fix signature.
427    
428    2008-08-03  Ingo Feinerer  <feinerer@logic.at>
429    
430            * R/weight.R: Introduce name abbreviations for weighting functions.
431    
432    2008-07-24  Ingo Feinerer  <feinerer@logic.at>
433    
434            * R/AAA.R (.onLoad, .Last): Start and stop MPI cluster.
435    
436            * R/cluster.R: Provide convenience functions for using a MPI
437            cluster.
438    
439            * R/termdocmatrix.R (TermDocMatrix): Use MPI cluster if
440            available.
441    
442            * R/textdoccol.R (tmIndex, tmFilter, tmMap): Use MPI cluster if
443            available.
444    
445    2008-07-17  Ingo Feinerer  <feinerer@logic.at>
446    
447            * R/textdoccol.R (lapply): Removed debug print out.
448    
449    2008-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
450    
451            * R/reader.R (readRCV1): Improved meta data extraction from
452            Reuters Corpus Volume 1 documents.
453    
454    2008-05-25  Ingo Feinerer  <h0125130@wu-wien.ac.at>
455    
456            * R/transform.R: Ensure that all mappings preserve multiline
457            structures.
458    
459    2008-05-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
460    
461            * R/filter.R: Every filter has now an attribute indicating whether
462            it sould be applied to document level (doclevel).
463    
464            * R/textdoccol.R (tmFilter): Set searchFullText as new default
465            filter.
466    
467    2008-04-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
468    
469            * R/transform.R (replacePatterns): Replaced removeWords by
470            replacePatterns. Suggested by Christian Buchta.
471    
472            * R/textdoccol.R (inspect): Improved formatting.
473    
474    2008-04-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
475    
476            * inst/CITATION: Updated JSS article information.
477    
478            * R/textdoccol.R (setAs): Added coerce method from list to
479            corpus.
480    
481            * R/meta.R (meta): Improved meta data handling.
482    
483    2008-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
484    
485            * R/textdoccol.R (materialize, tmMap): Improvements suggested by
486            Christian Buchta.
487    
488            * inst/CITATION: Added template to include JSS article reference.
489    
490    2008-03-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
491    
492            * R/textdoccol.R (tmMap): Introduced lazy mapping.
493    
494            * R/source.R: Added VectorSource.
495    
496    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
497    
498            * man/: Language codes should be in ISO 639-1 format.
499    
500            * R/textdoccol.R (asPlain): Preserve local meta data.
501    
502    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
503    
504            * R/textdoccol.R (writeCorpus): Function for writing a corpus
505            containing plain text documents to disk.
506    
507    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
508    
509            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
510            always set correctly.
511    
512            * R/textdoccol.R: Set load = TRUE as default for load on demand
513            since in most cases this is the wanted behaviour.
514    
515    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
516    
517            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
518    
519            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
520    
521    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
522    
523            * R/meta.R (meta): New function for consistent access to meta data
524            of document collections, repositories, and texts.
525    
526    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
527    
528            * R/: Better support for encodings.
529    
530    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
531    
532            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
533            selection when no reader argument is given.
534    
535    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
536    
537            * R/source.R (CSVSource): Now uses read.csv instead of scan
538            internally.
539    
540  2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
541    
542          * R/reader.R (getReaders): Returns available reader functions.          * R/reader.R (getReaders): Returns available reader functions.

Legend:
Removed from v.806  
changed lines
  Added in v.1164

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge