SCM

SCM Repository

[tm] Diff of /pkg/ChangeLog
ViewVC logotype

Diff of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/tm/ChangeLog revision 806, Wed Jan 2 10:29:14 2008 UTC pkg/ChangeLog revision 1155, Thu Nov 17 16:53:26 2011 UTC
# Line 1  Line 1 
1    2011-11-17  Ingo Feinerer  <feinerer@logic.at>
2    
3            * R/reader.R (readPDF): Use tools:::pdf_info() instead of external
4            pdfinfo tool.
5    
6            * inst/stopwords/SMART.dat: Add SMART information retrieval system
7            stopwords (which are also used by the MC toolkit).
8    
9            * R/matrix (termFreq): Allow local option \code{bounds$local} to
10            restrict how often a term may appear in each document (generalizes
11            \code{minDocFreq}). Similarly the local option \code{wordLenghts}
12            for word length bounds (generalizes \code{minWordLength}).
13    
14            * R/matrix.R (TermDocumentMatrix.VCorpus): New global option
15            \code{bounds$global} for restricting how often a term is allowed
16            to appear in different documents.
17    
18            * R/matrix.R (TermDocumentMatrix.VCorpus): Distinguish between
19            local options delegated internally to termFreq() and global
20            options which are processed by the term-document matrix
21            constructor itself.
22    
23    2011-11-15  Ingo Feinerer  <feinerer@logic.at>
24    
25            * man/getTokenizers.Rd: Document getTokenizers().
26    
27            * man/tokenizer.Rd: Document MC_tokenizer() and scan_tokenizer().
28    
29    2011-11-04  Ingo Feinerer  <feinerer@logic.at>
30    
31            * man/matrix.Rd: Document as.TermDocumentMatrix.term_frequency.
32    
33            * man/combine.Rd: Document c.term_frequency().
34    
35    2011-10-11  Ingo Feinerer  <feinerer@logic.at>
36    
37            * R/meta.R (`meta<-.Corpus`): Assume that the replacement value
38            can be accessed via '[' and not '[['.
39    
40    2011-08-24  Ingo Feinerer  <feinerer@logic.at>
41    
42            * R/stopwords.R (stopwords): Raise an error if no stopwords are
43            available for requested language. Suggested by Derek M Jones.
44    
45    2011-05-27  Ingo Feinerer  <feinerer@logic.at>
46    
47            * R/weight.R (weightSMART): Implement Cosine and pivoted unique
48            normalization.
49    
50    2011-02-17  Ingo Feinerer  <feinerer@logic.at>
51    
52            * R/transform.R (stemDocument.PlainTextDocument): Use language
53            argument.
54    
55    2011-02-04  Ingo Feinerer  <feinerer@logic.at>
56    
57            * R/source.R: Store strings and connections instead of unevaluated
58            calls.
59    
60    2010-11-26  Ingo Feinerer  <feinerer@logic.at>
61    
62            * R/corpus.R (Corpus): Allow init and exit hooks for readers.
63    
64    2010-10-22  Ingo Feinerer  <feinerer@logic.at>
65    
66            * R/matrix.R (.TermDocumentMatrix): Make Weighting an attribute
67            (instead of a list element).
68    
69    2010-10-16  Ingo Feinerer  <feinerer@logic.at>
70    
71            * R/corpus.R (`[[.VCorpus`, `[[.PCorpus'): Access individual
72            documents by names (fallback to IDs if names are not set).
73    
74    2010-08-25  Ingo Feinerer  <feinerer@logic.at>
75    
76            * R/corpus.R (c.Corpus): When concatenating corpora, the argument
77            \code{recursive} now determines whether existing corpus meta data
78            is used.
79    
80    2010-08-06  Ingo Feinerer  <feinerer@logic.at>
81    
82            * R/transform.R: Removed convert_UTF_8(). Use enc2utf8() instead.
83    
84    2010-06-17  Ingo Feinerer  <feinerer@logic.at>
85    
86            * R/matrix.R (TermDocumentMatrix): If a dictionary is given do not
87            remove terms not occurring in the corpus anymore.
88    
89    2010-06-02  Ingo Feinerer  <feinerer@logic.at>
90    
91            * R/plot.R (Zipf_plot, Heaps_plot): Plotting functions for Zipf's
92            and Heaps' law.
93    
94    2010-05-18  Ingo Feinerer  <feinerer@logic.at>
95    
96            * R/corpus.R (Corpus, PCorpus): Use element names as IDs if
97            provided by a source.
98    
99    2010-04-09  Ingo Feinerer  <feinerer@logic.at>
100    
101            * R/source.R (.Source): Provide document names.
102    
103    2010-04-07  Ingo Feinerer  <feinerer@logic.at>
104    
105            * R/meta.R (`content_or_meta`): Utility function.
106    
107    2010-03-19  Ingo Feinerer  <feinerer@logic.at>
108    
109            * R/reader.R (readReut21578XML, readReut21578XMLasPlain): Extract
110            TOPICS, LEWISSPLIT, CGISPLIT, and OLDID meta tags.
111    
112    2010-03-03  Ingo Feinerer  <feinerer@logic.at>
113    
114            * R/weight.R (weightTfIdf): Added normalization option.
115    
116            * man/tm_tag_score.Rd: Add General Inquirer example for sentiment
117            analysis.
118    
119    2010-02-25  Ingo Feinerer  <feinerer@logic.at>
120    
121            * R/score.R (tm_tag_score): Compute a score from the number of
122            tags matching in a document.
123    
124    2010-02-18  Ingo Feinerer  <feinerer@logic.at>
125    
126            * R/complete.R (stemCompletion): New completion heuristics.
127    
128    2010-02-17  Ingo Feinerer  <feinerer@logic.at>
129    
130            * R/plot.R (plot.TermDocumentMatrix): Memory improvements.
131    
132    2010-02-06  Ingo Feinerer  <feinerer@logic.at>
133    
134            * DESCRIPTION (Depends): Depend on R (>= 2.10.0) to ensure that
135            setOldClass(c(..., "list")) works.
136    
137    2010-01-22  Ingo Feinerer  <feinerer@logic.at>
138    
139            * R/transform.R (stemDocument.character): In case input is a
140            simple character just delegate to the default Snowball stemmer.
141    
142    2010-01-15  Ingo Feinerer  <feinerer@logic.at>
143    
144            * R/reader.R (readReut21578XML, readRCV1): Extract more meta
145            data.
146    
147    2010-01-12  Ingo Feinerer  <feinerer@logic.at>
148    
149            * R/doc.R (`Content<-`): Be careful with names attribute.
150    
151    2010-01-07  Stefan Theussl  <stefan.theussl@wu.ac.at>
152    
153            * R/source.R (DirSource): Improved implementation especially when
154            handling many (> 1M) files.
155    
156    2009-12-22  Ingo Feinerer  <feinerer@logic.at>
157    
158            * R/source.R (getElem.URISource): Use encoding argument.
159    
160    2009-12-11  Ingo Feinerer  <feinerer@logic.at>
161    
162            * R/doc.R (setOldClass): Register S3 document classes to be
163            recognized by S4 methods.
164    
165    2009-11-25  Ingo Feinerer  <feinerer@logic.at>
166    
167            * R/matrix.R (termFreq): Add option to remove punctuation
168            characters.
169    
170    2009-11-19  Ingo Feinerer  <feinerer@logic.at>
171    
172            * R/matrix.R (c.TermDocumentMatrix): Added combine method for
173            merging multiple term-document matrices.
174    
175    2009-11-17  Ingo Feinerer  <feinerer@logic.at>
176    
177            * R/corpus.R (setOldClass): Register S3 corpus classes to be
178            recognized by S4 methods.
179    
180            * man/plot.Rd: Use \dontrun{} in \examples{} section in the hope
181            that CRAN Mac OS X builds do not fail any longer.
182    
183    2009-11-15  Ingo Feinerer  <feinerer@logic.at>
184    
185            * R/matrix.R (tokenize): Use scan(..., what = "character") instead
186            of RWeka:AlphabeticTokenizer() as default.
187    
188    2009-11-14  Ingo Feinerer  <feinerer@logic.at>
189    
190            * R/transform.R (removeWords.PlainTextDocument): Fix bug which
191            caused words at the beginning or the end of a line not to be removed. Do
192            not delete whitespace anymore.
193    
194    2009-11-12  Ingo Feinerer  <feinerer@logic.at>
195    
196            * R/source.R (DirSource): Default to working directory if no path
197            is specified.
198    
199    2009-11-11  Ingo Feinerer  <feinerer@logic.at>
200    
201            * R/source.R (DirSource): Stop on empty directories.
202    
203    2009-11-07  Ingo Feinerer  <feinerer@logic.at>
204    
205            * R/matrix.R (TermDocumentMatrix): Avoid prefixes originating from
206            named documents.
207    
208    2009-10-21  Ingo Feinerer  <feinerer@logic.at>
209    
210            * R/transform.R (removeWords): Improve regular expressions.
211    
212    2009-10-19  Ingo Feinerer  <feinerer@logic.at>
213    
214            * R/meta.R (DublinCore): Allow lower case tags.
215    
216    2009-10-09  Ingo Feinerer  <feinerer@logic.at>
217    
218            * R/source.R (GmaneSource, ReutersSource): Use xmlChildren(x)
219            instead of x$children.
220    
221    2009-09-15  Ingo Feinerer  <feinerer@logic.at>
222    
223            * R/preprocess.R (preprocessReut21578XML): Fix generated file names.
224    
225    2009-09-06  Ingo Feinerer  <feinerer@logic.at>
226    
227            * R/: Use S3 instead of S4 class system.
228    
229    2009-08-11  Ingo Feinerer  <feinerer@logic.at>
230    
231            * R/reader.R (readMail): Moved to tm.plugin.mail package.
232    
233    2009-07-04  Ingo Feinerer  <feinerer@logic.at>
234    
235            * R/reader.R (readNewsgroup): Rename to readMail as newsgroup
236            postings are basically e-mails with some extra headers.
237    
238    2009-07-03  Ingo Feinerer  <feinerer@logic.at>
239    
240            * R/transform.R: Move convertMboxEml, removeCitation,
241            removeMultipart, and removeSignature to the tm.plugin.mail package
242            since they are mainly utility functions (for handling e-mails) and
243            not very framework specific.
244    
245    2009-06-28  Ingo Feinerer  <feinerer@logic.at>
246    
247            * man/: Fix documentation.
248    
249    2009-06-26  Ingo Feinerer  <feinerer@logic.at>
250    
251            * R/reader.R (readReut21578XMLasPlain): New reader which returns a
252            plain text document instead of an XML document for texts of the
253            Reuters-21578 dataset.
254    
255            * R/sparse.R: Removed since the slam package is now available on
256            CRAN.
257    
258            * DESCRIPTION (Depends): Add slam package.
259    
260    2009-06-17  Ingo Feinerer  <feinerer@logic.at>
261    
262            * R/transform.R (stemDoc): Fix character(0) handling.
263    
264    2009-06-12  Ingo Feinerer  <feinerer@logic.at>
265    
266            * R/doc.R (show): Pretty print.
267    
268    2009-05-27  Ingo Feinerer  <feinerer@logic.at>
269    
270            * R/matrix.R (print.TermDocumentMatrix): Handle empty matrices
271            gracefully.
272    
273    2009-05-13  Ingo Feinerer  <feinerer@logic.at>
274    
275            * R/corpus.R: Make corpus virtual. Implement corpus with standard
276            and permanent storage semantics.
277    
278            * DESCRIPTION: New major release. A *lot* of improvements.
279    
280    2009-05-04   Ingo Feinerer <feinerer@logic.at>
281    
282            * NAMESPACE: Export some simple_triplet_matrix functions.
283    
284    2009-04-28   Ingo Feinerer <feinerer@logic.at>
285    
286            * R/weight.R: Adapt tf-idf to new matrix format.
287    
288    2009-04-27  Ingo Feinerer  <feinerer@logic.at>
289    
290            * R/matrix.R: Create two distinct classes for term-document and
291            document-term matrices.
292    
293    2009-04-26  Ingo Feinerer  <feinerer@logic.at>
294    
295            * R/termdocmatrix.R: No longer use Matrix package. This reduces
296            package start-up time significantly.
297    
298    2009-04-11  Ingo Feinerer  <feinerer@logic.at>
299    
300            * inst/doc/tm.Rnw: Fix code/documentation mismatch.
301    
302    2009-04-04  Ingo Feinerer  <feinerer@logic.at>
303    
304            * R/transform.R (tmReduce): Combine multiple maps into one
305            transformation.
306    
307    2009-04-03  Ingo Feinerer  <feinerer@logic.at>
308    
309            * R/weight.R: Remove weightLogical since it does not return a
310            dgCMatrix.
311    
312            * R/termdocmatrix.R: Removed TermDocMatrix. Use DocumentTermMatrix
313            or TermDocumentMatrix instead.
314    
315    2009-03-28  Ingo Feinerer  <feinerer@logic.at>
316    
317            * inst/doc/extensions.Rnw: Finished vignette.
318    
319    2009-03-27  Ingo Feinerer  <feinerer@logic.at>
320    
321            * R/termdocmatrix.R: Start to work on new TermDocumentMatrix and
322            DocumentTermMatrix representations.
323    
324    2009-03-23  Ingo Feinerer  <feinerer@logic.at>
325    
326            * R/reader.R (readXML): New reader for arbitrary XML files.
327    
328    2009-03-22  Ingo Feinerer  <feinerer@logic.at>
329    
330            * R/source.R (CSVSource): Defunct (use DataframeSource instead).
331            (XMLSource): New XMLSource class for arbitrary XML files.
332            (Source): New slot Vectorized.
333    
334    2009-03-21  Ingo Feinerer  <feinerer@logic.at>
335    
336            * R/reader.R (readTabular): Experimental reader for tabular data
337            structures which can be customized via user-defined mappings.
338    
339            * R/reader.R: Always use UTC time zone.
340    
341            * R/AAA.R (.onLoad): No longer try to start a MPI cluster.
342    
343    2009-03-20  Ingo Feinerer  <feinerer@logic.at>
344    
345            * R/reader.R (readDOC): Options can be passed over to antiword.
346    
347            * R/reader.R (readPDF): Options can be passed over to pdfinfo and
348            pdftotext.
349    
350    2009-03-10  Ingo Feinerer  <feinerer@logic.at>
351    
352            * R/source.R (DirSource): Add pattern and ignore.case arguments
353            which are internally passed over to list.files().
354    
355    2009-03-02  Ingo Feinerer  <feinerer@logic.at>
356    
357            * inst/doc/tm.Rnw: Suppress pointless loading message.
358    
359    2009-01-29  Ingo Feinerer  <feinerer@logic.at>
360    
361            * DESCRIPTION: Speed up package loading (via moving packages not
362            strictly necessary for normal operation to Suggests instead of
363            Depends).
364    
365    2009-01-08  Ingo Feinerer  <feinerer@logic.at>
366    
367            * R/reader.R (readNewsgroup): The date format is now configurable.
368    
369    2008-12-20  Ingo Feinerer  <feinerer@logic.at>
370    
371            * R/preprocess.R (convertMboxEml): Fix off-by-one error.
372    
373    2008-12-16  Ingo Feinerer  <feinerer@logic.at>
374    
375            * R/termdocmatrix.R (TermDocMatrix): Sort row indices.
376    
377    2008-12-06  Ingo Feinerer  <feinerer@logic.at>
378    
379            * R/source.R (DataframeSource): New source class for data frames.
380    
381            * R/source.R: Fixed non-standard call evaluation.
382    
383    2008-11-29  Ingo Feinerer  <feinerer@logic.at>
384    
385            * R/source.R (URISource): New source class for a single document.
386    
387    2008-11-27  Ingo Feinerer  <feinerer@logic.at>
388    
389            * R/source.R: Refactoring.
390    
391    2008-11-25  Ingo Feinerer  <feinerer@logic.at>
392    
393            * R/AAA.R (.onLoad, .Last): Use tryCatch() to handle misconfigured
394            Rmpi installations more gracefully.
395    
396    2008-11-08  Ingo Feinerer  <feinerer@logic.at>
397    
398            * R/source.R (Source): Add Length slot.
399    
400    2008-11-06  Ingo Feinerer  <feinerer@logic.at>
401    
402            * R/AAA.R: Unify duplicated .onLoad function.
403    
404    2008-11-03  Ingo Feinerer  <feinerer@logic.at>
405    
406            * DESCRIPTION (Suggests): Added Rmpi.
407    
408    2008-11-02  Ingo Feinerer  <feinerer@logic.at>
409    
410            * R/source.R (getElem): Fix 'no visible binding' warning.
411    
412            * man/WeightFunction.Rd: Fix signature.
413    
414    2008-08-03  Ingo Feinerer  <feinerer@logic.at>
415    
416            * R/weight.R: Introduce name abbreviations for weighting functions.
417    
418    2008-07-24  Ingo Feinerer  <feinerer@logic.at>
419    
420            * R/AAA.R (.onLoad, .Last): Start and stop MPI cluster.
421    
422            * R/cluster.R: Provide convenience functions for using a MPI
423            cluster.
424    
425            * R/termdocmatrix.R (TermDocMatrix): Use MPI cluster if
426            available.
427    
428            * R/textdoccol.R (tmIndex, tmFilter, tmMap): Use MPI cluster if
429            available.
430    
431    2008-07-17  Ingo Feinerer  <feinerer@logic.at>
432    
433            * R/textdoccol.R (lapply): Removed debug print out.
434    
435    2008-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
436    
437            * R/reader.R (readRCV1): Improved meta data extraction from
438            Reuters Corpus Volume 1 documents.
439    
440    2008-05-25  Ingo Feinerer  <h0125130@wu-wien.ac.at>
441    
442            * R/transform.R: Ensure that all mappings preserve multiline
443            structures.
444    
445    2008-05-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
446    
447            * R/filter.R: Every filter has now an attribute indicating whether
448            it sould be applied to document level (doclevel).
449    
450            * R/textdoccol.R (tmFilter): Set searchFullText as new default
451            filter.
452    
453    2008-04-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
454    
455            * R/transform.R (replacePatterns): Replaced removeWords by
456            replacePatterns. Suggested by Christian Buchta.
457    
458            * R/textdoccol.R (inspect): Improved formatting.
459    
460    2008-04-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
461    
462            * inst/CITATION: Updated JSS article information.
463    
464            * R/textdoccol.R (setAs): Added coerce method from list to
465            corpus.
466    
467            * R/meta.R (meta): Improved meta data handling.
468    
469    2008-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
470    
471            * R/textdoccol.R (materialize, tmMap): Improvements suggested by
472            Christian Buchta.
473    
474            * inst/CITATION: Added template to include JSS article reference.
475    
476    2008-03-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
477    
478            * R/textdoccol.R (tmMap): Introduced lazy mapping.
479    
480            * R/source.R: Added VectorSource.
481    
482    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
483    
484            * man/: Language codes should be in ISO 639-1 format.
485    
486            * R/textdoccol.R (asPlain): Preserve local meta data.
487    
488    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
489    
490            * R/textdoccol.R (writeCorpus): Function for writing a corpus
491            containing plain text documents to disk.
492    
493    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
494    
495            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
496            always set correctly.
497    
498            * R/textdoccol.R: Set load = TRUE as default for load on demand
499            since in most cases this is the wanted behaviour.
500    
501    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
502    
503            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
504    
505            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
506    
507    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
508    
509            * R/meta.R (meta): New function for consistent access to meta data
510            of document collections, repositories, and texts.
511    
512    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
513    
514            * R/: Better support for encodings.
515    
516    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
517    
518            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
519            selection when no reader argument is given.
520    
521    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
522    
523            * R/source.R (CSVSource): Now uses read.csv instead of scan
524            internally.
525    
526  2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
527    
528          * R/reader.R (getReaders): Returns available reader functions.          * R/reader.R (getReaders): Returns available reader functions.

Legend:
Removed from v.806  
changed lines
  Added in v.1155

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge