SCM

SCM Repository

[tm] Diff of /pkg/ChangeLog
ViewVC logotype

Diff of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/tm/ChangeLog revision 806, Wed Jan 2 10:29:14 2008 UTC pkg/ChangeLog revision 1151, Thu Nov 17 14:21:49 2011 UTC
# Line 1  Line 1 
1    2011-11-17  Ingo Feinerer  <feinerer@logic.at>
2    
3            * R/matrix (termFreq): Allow local option \code{bounds$local} to
4            restrict how often a term may appear in each document (generalizes
5            \code{minDocFreq}). Similarly the local option \code{wordLenghts}
6            for word length bounds (generalizes \code{minWordLength}).
7    
8            * R/matrix.R (TermDocumentMatrix.VCorpus): New global option
9            \code{bounds$global} for restricting how often a term is allowed
10            to appear in different documents.
11    
12            * R/matrix.R (TermDocumentMatrix.VCorpus): Distinguish between
13            local options delegated internally to termFreq() and global
14            options which are processed by the term-document matrix
15            constructor itself.
16    
17    2011-11-15  Ingo Feinerer  <feinerer@logic.at>
18    
19            * man/getTokenizers.Rd: Document getTokenizers().
20    
21            * man/tokenizer.Rd: Document MC_tokenizer() and scan_tokenizer().
22    
23    2011-11-04  Ingo Feinerer  <feinerer@logic.at>
24    
25            * man/matrix.Rd: Document as.TermDocumentMatrix.term_frequency.
26    
27            * man/combine.Rd: Document c.term_frequency().
28    
29    2011-10-11  Ingo Feinerer  <feinerer@logic.at>
30    
31            * R/meta.R (`meta<-.Corpus`): Assume that the replacement value
32            can be accessed via '[' and not '[['.
33    
34    2011-08-24  Ingo Feinerer  <feinerer@logic.at>
35    
36            * R/stopwords.R (stopwords): Raise an error if no stopwords are
37            available for requested language. Suggested by Derek M Jones.
38    
39    2011-05-27  Ingo Feinerer  <feinerer@logic.at>
40    
41            * R/weight.R (weightSMART): Implement Cosine and pivoted unique
42            normalization.
43    
44    2011-02-17  Ingo Feinerer  <feinerer@logic.at>
45    
46            * R/transform.R (stemDocument.PlainTextDocument): Use language
47            argument.
48    
49    2011-02-04  Ingo Feinerer  <feinerer@logic.at>
50    
51            * R/source.R: Store strings and connections instead of unevaluated
52            calls.
53    
54    2010-11-26  Ingo Feinerer  <feinerer@logic.at>
55    
56            * R/corpus.R (Corpus): Allow init and exit hooks for readers.
57    
58    2010-10-22  Ingo Feinerer  <feinerer@logic.at>
59    
60            * R/matrix.R (.TermDocumentMatrix): Make Weighting an attribute
61            (instead of a list element).
62    
63    2010-10-16  Ingo Feinerer  <feinerer@logic.at>
64    
65            * R/corpus.R (`[[.VCorpus`, `[[.PCorpus'): Access individual
66            documents by names (fallback to IDs if names are not set).
67    
68    2010-08-25  Ingo Feinerer  <feinerer@logic.at>
69    
70            * R/corpus.R (c.Corpus): When concatenating corpora, the argument
71            \code{recursive} now determines whether existing corpus meta data
72            is used.
73    
74    2010-08-06  Ingo Feinerer  <feinerer@logic.at>
75    
76            * R/transform.R: Removed convert_UTF_8(). Use enc2utf8() instead.
77    
78    2010-06-17  Ingo Feinerer  <feinerer@logic.at>
79    
80            * R/matrix.R (TermDocumentMatrix): If a dictionary is given do not
81            remove terms not occurring in the corpus anymore.
82    
83    2010-06-02  Ingo Feinerer  <feinerer@logic.at>
84    
85            * R/plot.R (Zipf_plot, Heaps_plot): Plotting functions for Zipf's
86            and Heaps' law.
87    
88    2010-05-18  Ingo Feinerer  <feinerer@logic.at>
89    
90            * R/corpus.R (Corpus, PCorpus): Use element names as IDs if
91            provided by a source.
92    
93    2010-04-09  Ingo Feinerer  <feinerer@logic.at>
94    
95            * R/source.R (.Source): Provide document names.
96    
97    2010-04-07  Ingo Feinerer  <feinerer@logic.at>
98    
99            * R/meta.R (`content_or_meta`): Utility function.
100    
101    2010-03-19  Ingo Feinerer  <feinerer@logic.at>
102    
103            * R/reader.R (readReut21578XML, readReut21578XMLasPlain): Extract
104            TOPICS, LEWISSPLIT, CGISPLIT, and OLDID meta tags.
105    
106    2010-03-03  Ingo Feinerer  <feinerer@logic.at>
107    
108            * R/weight.R (weightTfIdf): Added normalization option.
109    
110            * man/tm_tag_score.Rd: Add General Inquirer example for sentiment
111            analysis.
112    
113    2010-02-25  Ingo Feinerer  <feinerer@logic.at>
114    
115            * R/score.R (tm_tag_score): Compute a score from the number of
116            tags matching in a document.
117    
118    2010-02-18  Ingo Feinerer  <feinerer@logic.at>
119    
120            * R/complete.R (stemCompletion): New completion heuristics.
121    
122    2010-02-17  Ingo Feinerer  <feinerer@logic.at>
123    
124            * R/plot.R (plot.TermDocumentMatrix): Memory improvements.
125    
126    2010-02-06  Ingo Feinerer  <feinerer@logic.at>
127    
128            * DESCRIPTION (Depends): Depend on R (>= 2.10.0) to ensure that
129            setOldClass(c(..., "list")) works.
130    
131    2010-01-22  Ingo Feinerer  <feinerer@logic.at>
132    
133            * R/transform.R (stemDocument.character): In case input is a
134            simple character just delegate to the default Snowball stemmer.
135    
136    2010-01-15  Ingo Feinerer  <feinerer@logic.at>
137    
138            * R/reader.R (readReut21578XML, readRCV1): Extract more meta
139            data.
140    
141    2010-01-12  Ingo Feinerer  <feinerer@logic.at>
142    
143            * R/doc.R (`Content<-`): Be careful with names attribute.
144    
145    2010-01-07  Stefan Theussl  <stefan.theussl@wu.ac.at>
146    
147            * R/source.R (DirSource): Improved implementation especially when
148            handling many (> 1M) files.
149    
150    2009-12-22  Ingo Feinerer  <feinerer@logic.at>
151    
152            * R/source.R (getElem.URISource): Use encoding argument.
153    
154    2009-12-11  Ingo Feinerer  <feinerer@logic.at>
155    
156            * R/doc.R (setOldClass): Register S3 document classes to be
157            recognized by S4 methods.
158    
159    2009-11-25  Ingo Feinerer  <feinerer@logic.at>
160    
161            * R/matrix.R (termFreq): Add option to remove punctuation
162            characters.
163    
164    2009-11-19  Ingo Feinerer  <feinerer@logic.at>
165    
166            * R/matrix.R (c.TermDocumentMatrix): Added combine method for
167            merging multiple term-document matrices.
168    
169    2009-11-17  Ingo Feinerer  <feinerer@logic.at>
170    
171            * R/corpus.R (setOldClass): Register S3 corpus classes to be
172            recognized by S4 methods.
173    
174            * man/plot.Rd: Use \dontrun{} in \examples{} section in the hope
175            that CRAN Mac OS X builds do not fail any longer.
176    
177    2009-11-15  Ingo Feinerer  <feinerer@logic.at>
178    
179            * R/matrix.R (tokenize): Use scan(..., what = "character") instead
180            of RWeka:AlphabeticTokenizer() as default.
181    
182    2009-11-14  Ingo Feinerer  <feinerer@logic.at>
183    
184            * R/transform.R (removeWords.PlainTextDocument): Fix bug which
185            caused words at the beginning or the end of a line not to be removed. Do
186            not delete whitespace anymore.
187    
188    2009-11-12  Ingo Feinerer  <feinerer@logic.at>
189    
190            * R/source.R (DirSource): Default to working directory if no path
191            is specified.
192    
193    2009-11-11  Ingo Feinerer  <feinerer@logic.at>
194    
195            * R/source.R (DirSource): Stop on empty directories.
196    
197    2009-11-07  Ingo Feinerer  <feinerer@logic.at>
198    
199            * R/matrix.R (TermDocumentMatrix): Avoid prefixes originating from
200            named documents.
201    
202    2009-10-21  Ingo Feinerer  <feinerer@logic.at>
203    
204            * R/transform.R (removeWords): Improve regular expressions.
205    
206    2009-10-19  Ingo Feinerer  <feinerer@logic.at>
207    
208            * R/meta.R (DublinCore): Allow lower case tags.
209    
210    2009-10-09  Ingo Feinerer  <feinerer@logic.at>
211    
212            * R/source.R (GmaneSource, ReutersSource): Use xmlChildren(x)
213            instead of x$children.
214    
215    2009-09-15  Ingo Feinerer  <feinerer@logic.at>
216    
217            * R/preprocess.R (preprocessReut21578XML): Fix generated file names.
218    
219    2009-09-06  Ingo Feinerer  <feinerer@logic.at>
220    
221            * R/: Use S3 instead of S4 class system.
222    
223    2009-08-11  Ingo Feinerer  <feinerer@logic.at>
224    
225            * R/reader.R (readMail): Moved to tm.plugin.mail package.
226    
227    2009-07-04  Ingo Feinerer  <feinerer@logic.at>
228    
229            * R/reader.R (readNewsgroup): Rename to readMail as newsgroup
230            postings are basically e-mails with some extra headers.
231    
232    2009-07-03  Ingo Feinerer  <feinerer@logic.at>
233    
234            * R/transform.R: Move convertMboxEml, removeCitation,
235            removeMultipart, and removeSignature to the tm.plugin.mail package
236            since they are mainly utility functions (for handling e-mails) and
237            not very framework specific.
238    
239    2009-06-28  Ingo Feinerer  <feinerer@logic.at>
240    
241            * man/: Fix documentation.
242    
243    2009-06-26  Ingo Feinerer  <feinerer@logic.at>
244    
245            * R/reader.R (readReut21578XMLasPlain): New reader which returns a
246            plain text document instead of an XML document for texts of the
247            Reuters-21578 dataset.
248    
249            * R/sparse.R: Removed since the slam package is now available on
250            CRAN.
251    
252            * DESCRIPTION (Depends): Add slam package.
253    
254    2009-06-17  Ingo Feinerer  <feinerer@logic.at>
255    
256            * R/transform.R (stemDoc): Fix character(0) handling.
257    
258    2009-06-12  Ingo Feinerer  <feinerer@logic.at>
259    
260            * R/doc.R (show): Pretty print.
261    
262    2009-05-27  Ingo Feinerer  <feinerer@logic.at>
263    
264            * R/matrix.R (print.TermDocumentMatrix): Handle empty matrices
265            gracefully.
266    
267    2009-05-13  Ingo Feinerer  <feinerer@logic.at>
268    
269            * R/corpus.R: Make corpus virtual. Implement corpus with standard
270            and permanent storage semantics.
271    
272            * DESCRIPTION: New major release. A *lot* of improvements.
273    
274    2009-05-04   Ingo Feinerer <feinerer@logic.at>
275    
276            * NAMESPACE: Export some simple_triplet_matrix functions.
277    
278    2009-04-28   Ingo Feinerer <feinerer@logic.at>
279    
280            * R/weight.R: Adapt tf-idf to new matrix format.
281    
282    2009-04-27  Ingo Feinerer  <feinerer@logic.at>
283    
284            * R/matrix.R: Create two distinct classes for term-document and
285            document-term matrices.
286    
287    2009-04-26  Ingo Feinerer  <feinerer@logic.at>
288    
289            * R/termdocmatrix.R: No longer use Matrix package. This reduces
290            package start-up time significantly.
291    
292    2009-04-11  Ingo Feinerer  <feinerer@logic.at>
293    
294            * inst/doc/tm.Rnw: Fix code/documentation mismatch.
295    
296    2009-04-04  Ingo Feinerer  <feinerer@logic.at>
297    
298            * R/transform.R (tmReduce): Combine multiple maps into one
299            transformation.
300    
301    2009-04-03  Ingo Feinerer  <feinerer@logic.at>
302    
303            * R/weight.R: Remove weightLogical since it does not return a
304            dgCMatrix.
305    
306            * R/termdocmatrix.R: Removed TermDocMatrix. Use DocumentTermMatrix
307            or TermDocumentMatrix instead.
308    
309    2009-03-28  Ingo Feinerer  <feinerer@logic.at>
310    
311            * inst/doc/extensions.Rnw: Finished vignette.
312    
313    2009-03-27  Ingo Feinerer  <feinerer@logic.at>
314    
315            * R/termdocmatrix.R: Start to work on new TermDocumentMatrix and
316            DocumentTermMatrix representations.
317    
318    2009-03-23  Ingo Feinerer  <feinerer@logic.at>
319    
320            * R/reader.R (readXML): New reader for arbitrary XML files.
321    
322    2009-03-22  Ingo Feinerer  <feinerer@logic.at>
323    
324            * R/source.R (CSVSource): Defunct (use DataframeSource instead).
325            (XMLSource): New XMLSource class for arbitrary XML files.
326            (Source): New slot Vectorized.
327    
328    2009-03-21  Ingo Feinerer  <feinerer@logic.at>
329    
330            * R/reader.R (readTabular): Experimental reader for tabular data
331            structures which can be customized via user-defined mappings.
332    
333            * R/reader.R: Always use UTC time zone.
334    
335            * R/AAA.R (.onLoad): No longer try to start a MPI cluster.
336    
337    2009-03-20  Ingo Feinerer  <feinerer@logic.at>
338    
339            * R/reader.R (readDOC): Options can be passed over to antiword.
340    
341            * R/reader.R (readPDF): Options can be passed over to pdfinfo and
342            pdftotext.
343    
344    2009-03-10  Ingo Feinerer  <feinerer@logic.at>
345    
346            * R/source.R (DirSource): Add pattern and ignore.case arguments
347            which are internally passed over to list.files().
348    
349    2009-03-02  Ingo Feinerer  <feinerer@logic.at>
350    
351            * inst/doc/tm.Rnw: Suppress pointless loading message.
352    
353    2009-01-29  Ingo Feinerer  <feinerer@logic.at>
354    
355            * DESCRIPTION: Speed up package loading (via moving packages not
356            strictly necessary for normal operation to Suggests instead of
357            Depends).
358    
359    2009-01-08  Ingo Feinerer  <feinerer@logic.at>
360    
361            * R/reader.R (readNewsgroup): The date format is now configurable.
362    
363    2008-12-20  Ingo Feinerer  <feinerer@logic.at>
364    
365            * R/preprocess.R (convertMboxEml): Fix off-by-one error.
366    
367    2008-12-16  Ingo Feinerer  <feinerer@logic.at>
368    
369            * R/termdocmatrix.R (TermDocMatrix): Sort row indices.
370    
371    2008-12-06  Ingo Feinerer  <feinerer@logic.at>
372    
373            * R/source.R (DataframeSource): New source class for data frames.
374    
375            * R/source.R: Fixed non-standard call evaluation.
376    
377    2008-11-29  Ingo Feinerer  <feinerer@logic.at>
378    
379            * R/source.R (URISource): New source class for a single document.
380    
381    2008-11-27  Ingo Feinerer  <feinerer@logic.at>
382    
383            * R/source.R: Refactoring.
384    
385    2008-11-25  Ingo Feinerer  <feinerer@logic.at>
386    
387            * R/AAA.R (.onLoad, .Last): Use tryCatch() to handle misconfigured
388            Rmpi installations more gracefully.
389    
390    2008-11-08  Ingo Feinerer  <feinerer@logic.at>
391    
392            * R/source.R (Source): Add Length slot.
393    
394    2008-11-06  Ingo Feinerer  <feinerer@logic.at>
395    
396            * R/AAA.R: Unify duplicated .onLoad function.
397    
398    2008-11-03  Ingo Feinerer  <feinerer@logic.at>
399    
400            * DESCRIPTION (Suggests): Added Rmpi.
401    
402    2008-11-02  Ingo Feinerer  <feinerer@logic.at>
403    
404            * R/source.R (getElem): Fix 'no visible binding' warning.
405    
406            * man/WeightFunction.Rd: Fix signature.
407    
408    2008-08-03  Ingo Feinerer  <feinerer@logic.at>
409    
410            * R/weight.R: Introduce name abbreviations for weighting functions.
411    
412    2008-07-24  Ingo Feinerer  <feinerer@logic.at>
413    
414            * R/AAA.R (.onLoad, .Last): Start and stop MPI cluster.
415    
416            * R/cluster.R: Provide convenience functions for using a MPI
417            cluster.
418    
419            * R/termdocmatrix.R (TermDocMatrix): Use MPI cluster if
420            available.
421    
422            * R/textdoccol.R (tmIndex, tmFilter, tmMap): Use MPI cluster if
423            available.
424    
425    2008-07-17  Ingo Feinerer  <feinerer@logic.at>
426    
427            * R/textdoccol.R (lapply): Removed debug print out.
428    
429    2008-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
430    
431            * R/reader.R (readRCV1): Improved meta data extraction from
432            Reuters Corpus Volume 1 documents.
433    
434    2008-05-25  Ingo Feinerer  <h0125130@wu-wien.ac.at>
435    
436            * R/transform.R: Ensure that all mappings preserve multiline
437            structures.
438    
439    2008-05-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
440    
441            * R/filter.R: Every filter has now an attribute indicating whether
442            it sould be applied to document level (doclevel).
443    
444            * R/textdoccol.R (tmFilter): Set searchFullText as new default
445            filter.
446    
447    2008-04-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
448    
449            * R/transform.R (replacePatterns): Replaced removeWords by
450            replacePatterns. Suggested by Christian Buchta.
451    
452            * R/textdoccol.R (inspect): Improved formatting.
453    
454    2008-04-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
455    
456            * inst/CITATION: Updated JSS article information.
457    
458            * R/textdoccol.R (setAs): Added coerce method from list to
459            corpus.
460    
461            * R/meta.R (meta): Improved meta data handling.
462    
463    2008-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
464    
465            * R/textdoccol.R (materialize, tmMap): Improvements suggested by
466            Christian Buchta.
467    
468            * inst/CITATION: Added template to include JSS article reference.
469    
470    2008-03-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
471    
472            * R/textdoccol.R (tmMap): Introduced lazy mapping.
473    
474            * R/source.R: Added VectorSource.
475    
476    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
477    
478            * man/: Language codes should be in ISO 639-1 format.
479    
480            * R/textdoccol.R (asPlain): Preserve local meta data.
481    
482    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
483    
484            * R/textdoccol.R (writeCorpus): Function for writing a corpus
485            containing plain text documents to disk.
486    
487    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
488    
489            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
490            always set correctly.
491    
492            * R/textdoccol.R: Set load = TRUE as default for load on demand
493            since in most cases this is the wanted behaviour.
494    
495    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
496    
497            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
498    
499            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
500    
501    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
502    
503            * R/meta.R (meta): New function for consistent access to meta data
504            of document collections, repositories, and texts.
505    
506    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
507    
508            * R/: Better support for encodings.
509    
510    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
511    
512            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
513            selection when no reader argument is given.
514    
515    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
516    
517            * R/source.R (CSVSource): Now uses read.csv instead of scan
518            internally.
519    
520  2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
521    
522          * R/reader.R (getReaders): Returns available reader functions.          * R/reader.R (getReaders): Returns available reader functions.

Legend:
Removed from v.806  
changed lines
  Added in v.1151

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge