SCM

SCM Repository

[tm] Diff of /pkg/ChangeLog
ViewVC logotype

Diff of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/R/textmin/ChangeLog revision 59, Tue Sep 26 12:24:09 2006 UTC trunk/tm/ChangeLog revision 836, Sat Apr 19 17:08:07 2008 UTC
# Line 1  Line 1 
1    2008-04-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
2    
3            * inst/CITATION: Updated JSS article information.
4    
5            * R/textdoccol.R (setAs): Added coerce method from list to
6            corpus.
7    
8            * R/meta.R (meta): Improved meta data handling.
9    
10    2008-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
11    
12            * R/textdoccol.R (materialize, tmMap): Improvements suggested by
13            Christian Buchta.
14    
15            * inst/CITATION: Added template to include JSS article reference.
16    
17    2008-03-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
18    
19            * R/textdoccol.R (tmMap): Introduced lazy mapping.
20    
21            * R/source.R: Added VectorSource.
22    
23    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
24    
25            * man/: Language codes should be in ISO 639-1 format.
26    
27            * R/textdoccol.R (asPlain): Preserve local meta data.
28    
29    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
30    
31            * R/textdoccol.R (writeCorpus): Function for writing a corpus
32            containing plain text documents to disk.
33    
34    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
35    
36            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
37            always set correctly.
38    
39            * R/textdoccol.R: Set load = TRUE as default for load on demand
40            since in most cases this is the wanted behaviour.
41    
42    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
43    
44            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
45    
46            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
47    
48    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
49    
50            * R/meta.R (meta): New function for consistent access to meta data
51            of document collections, repositories, and texts.
52    
53    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
54    
55            * R/: Better support for encodings.
56    
57    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
58    
59            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
60            selection when no reader argument is given.
61    
62    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
63    
64            * R/source.R (CSVSource): Now uses read.csv instead of scan
65            internally.
66    
67    2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
68    
69            * R/reader.R (getReaders): Returns available reader functions.
70    
71            * R/termdocmatrix.R (TermDocMatrix): Set new modular constructor
72            as default.
73    
74    2007-12-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
75    
76            * R/stopwords.R (stopwords): Shortened code, removed codetools
77            variable warnings.
78    
79            * man/: Documentation for showMeta, added an example for tmMap.
80    
81            * inst/doc/tm.Rnw: Updated vignette, comments on MS word reader,
82            some minor typos fixed.
83    
84    2007-12-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
85    
86            * R/aobjects.R (showMeta): Added method for pretty printing a
87            text document's meta data.
88    
89    2007-11-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
90    
91            * R/textdoccol.R (TextDocCol): Better handling of empty
92            arguments.
93    
94            * NAMESPACE: Exported readDOC.
95    
96            * man/completeStems.Rd: Added an example.
97    
98    2007-11-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
99    
100            * R/stopwords.R (stopwords): Look up .dat files at every
101            call. Allows users to modify stopword .dat files interactively.
102    
103    2007-11-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
104    
105            * R/termdocmatrix.R (termFreq): Correct processing of empty
106            documents.
107    
108    2007-10-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
109    
110            * man/: Updated documentation.
111    
112    2007-10-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
113    
114            * R/complete.R (completeStems): Completes (heuristically) word
115            stems.
116    
117            * R/termdocmatrix.R (TermDocMatrix2): New modular
118            constructor.
119    
120            * NAMESPACE: Exported termFreq.
121    
122    2007-10-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
123    
124            * R/reader.R (readDOC): Added MS Word reader (using antiword).
125    
126    2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
127    
128            * R/weight.R: Weighting functions for TermDocMatrix.
129    
130    2007-10-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
131    
132            * R/termdocmatrix.R (dimnames, colnames, rownames): Wrapper
133            functions for accessing dimension, column, and row names.
134    
135            * R/plot.R (plot.TermDocMatrix): Plot correlations between terms.
136    
137    2007-09-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
138    
139            * man/removePunctuation.Rd: Added documentation. Function also exported to NAMESPACE.
140    
141    2007-08-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
142    
143            * R/fungen.R: Use S4 class for function generators instead of S3 attributes.
144    
145    2007-07-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
146    
147            * R/reader.R (readPDF): Removed manual checks for pdftotext and
148            pdfinfo. The system call gives a warning anyway.
149    
150    2007-07-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
151    
152            * R/textdoccol.R (asPlain): Conversion from
153            StructuredTextDocuments to PlainTextDocuments.
154    
155    2007-07-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
156    
157            * R/termdocmatrix.R: Added convenience methods ("[", nrow, ncol)
158            for accessing term-document matrices.
159    
160            * inst/doc/tm.Rnw: readPDF is only called if pdftotext and pdfinfo
161            are installed.
162    
163    2007-07-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
164    
165            * R/termdocmatrix.R (TermDocMatrix): Improved efficiency. Kudos to
166            Christian Buchta.
167    
168    2007-07-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
169    
170            * inst/doc/tm.Rnw: Update vignette (readPDF, readHTML, preprocessReut21578XML).
171    
172    2007-07-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
173    
174            * R/reader.R (readHTML): Added very simple HTML reader to obtain StructuredTextDocuments.
175    
176            * R/reader.R (readPDF): Added PDF reader.
177    
178    2007-07-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
179    
180            * DESCRIPTION: Moved proxy from Depends to Imports to avoid name clashes.
181    
182            * inst/stopwords/english.dat: Added the term "yes" to stopwords.
183    
184            * R/termdocmatrix.R (dim): dim function for TermDocMatrix.
185    
186            * R/preprocess.R (convertMboxEml): Accepts gzipped mboxes.
187    
188    2007-07-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
189    
190            * R/distmeasure.R (dissimilarity): Replaced dists call from
191            package cba by new dist call from package proxy.
192    
193    2007-07-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
194    
195            * inst/doc/tm.Rnw: Described removeSparseTerms and Dictionary.
196    
197    2007-06-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
198    
199            * R/termdocmatrix.R: require() uses the quietly option to suppress
200            loading messages.
201    
202    2007-06-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
203    
204            * R/dictionary.R: Added dictionary support.
205    
206    2007-06-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
207    
208            * R/aobjects.R: Added classes for Reuters21578 XML and RCV1
209            documents. This simplifies some functions, e.g., asPlain.
210    
211    2007-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
212    
213            * inst/doc/tm.Rnw: Fixed some typos in vignette.
214    
215    2007-06-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
216    
217            * R/textdoccol.R (replaceWords): Added method to replace a set of
218            words by a single word. Useful for synonyms.
219    
220    2007-05-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
221    
222            * man/TermDocMatrix.Rd: Fixed documentation on Data slot.
223    
224    2007-05-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
225    
226            * R/termdocmatrix.R (textvector): Small fix for dealing with empty
227            vectors. Thanks to Ariel Maguyon for his error report.
228            (removeSparseTerms): New function to remove columns from a
229            term-document matrix exceeding a sparse factor.
230    
231    2007-05-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
232    
233            * man/tmUpdate.Rd: Corrected documentation on readerControl parameter.
234    
235    2007-05-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
236    
237            * man/sFilter.Rd: Corrected documentation on statement format (use
238            '==' instead of '=').
239    
240    2007-05-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
241    
242            * R/aobjects.R (StructuredTextDocument): Inherits from
243            TextDocument.
244    
245    2007-05-04  Ingo Feinerer  <h0125130@wu-wien.ac.at>
246    
247            * R/termdocmatrix.R (findFreqTerms): Perform efficient computation
248            on sparse matrices as proposed by Martin Maechler.
249    
250    2007-04-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
251    
252            * R/textdoccol.R: Removed \code{dbDisconnect} calls since last
253            \pkg{filehash} version makes them deprecated.
254    
255    2007-04-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
256    
257            * R/termdocmatrix.R (textvector): Stemming is now performed before
258            erasing stopwords.
259            (weightMatrix): Adapted to handle sparse matrices.
260            (TermDocMatrix): Sparse matrix is now efficiently built by
261            direct stepwise insertion of row values into it.
262    
263    2007-04-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
264    
265            * DESCRIPTION: Replaced \pkg{filehashSQLite} with \pkg{filehash}
266            due to ongoing problems. For our purposes the latter is as useful
267            as the replaced package.
268    
269    2007-04-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
270    
271            * man/TextDocCol.Rd: Replaced \code{readPlain} with \code{object@DefaultReader}.
272    
273            * man/TermDocMatrix.Rd: Remove deprecated \code{language} argument.
274    
275    2007-04-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
276    
277            * R/resolve.R (resolveISOCode): Added ISO 639-1 codes for
278            languages with available stopwords.
279    
280    2007-04-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
281    
282            * inst/doc/tm.Rnw: Minor corrections in the vignette.
283    
284    2007-04-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
285    
286            * DESCRIPTION: Update to version 0.2, since a lot of new features
287            have been integrated.
288    
289            * inst/stopwords: Updated existing stopwords and added stopwords
290            for various other languages.
291    
292    2007-04-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
293    
294            * man/: Updated documentation.
295    
296            * Work/testDb.R: Script to test database stuff.
297    
298            * R/: Fixed various database related bugs. Seems to be rather
299            useable now, i.e., consider as alpha status for now.
300    
301    2007-04-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
302    
303            * R/: Fixed some bugs related to database support.
304    
305    2007-04-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
306    
307            * man/: Added a lot of examples to the manuals.
308    
309    2007-04-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
310    
311            * man/: Updated parts of the documentation.
312    
313            * R/textdoccol.R (asPlain): Added conversion from newsgroup
314            documents to plain text documents.
315    
316    2007-04-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
317    
318            * R/textdoccol.R: Finished experimental database support. Not yet
319            intensively tested.
320    
321            * R/source.R: Now each source has a default reader.
322    
323            * R/reader.R: \code{FunctionGenerator} is now an attribute, not a
324            class anymore.
325    
326            * R/plaintextdoc.R: Custom show method for plain text documents.
327    
328            * R/aobjects.R: Added a class for structured text documents.
329    
330            * R/reader.R: Replaced remaining \code{parser} occurrences with
331            \code{reader}.
332    
333            * R/textdoccol.R (summary): Indent tags.
334    
335            * R/textdoccol.R (removePunctuation): Transform method to remove
336            punctuation marks.
337    
338    2007-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
339    
340            * R/textdoccol.R (sFilter): Simplified sFilter significantly by
341            using prescindMeta().
342    
343    2007-03-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
344    
345            * R/textdoccol.R: Improved database support.
346    
347    2007-03-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
348    
349            * R/termdocmatrix.R (TermDocMatrix): Uses sparse matrices.
350    
351            * R/resolve.R (resolveISOcode): Extracts the language from a ISO
352            language code.
353    
354            * R/textdoccol.R (TextDocCol): Refactored several parser arguments
355            into parserControl argument.
356    
357            * R/aobjects.R (TextDocument): Introduced the "Language" slot.
358    
359    2007-03-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
360    
361            * Work/tmDataSetup.R: The datasets acq and crude can now be
362            created on the fly.
363    
364            * R/stopwords.R: Introduced a function returning the stopwords for
365            a given language (English, German and French at the moment)
366    
367            * R/textdoccol.R (stemDoc): Stemming uses Rstem if available,
368            otherwise falls back to Snowball package.
369    
370    2007-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
371    
372            * man/dissimilarity-methods.Rd: Make clear that any method offered
373            by "dists" from package "cba" can be used.
374    
375    2007-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
376    
377            * inst/doc/tm.Rnw: Fixed quotes-appearing-as-boxes-bug according
378            to Kurt's latex suggestion. Removed points and underscores in
379            variable names for consistent naming.
380    
381            * DESCRIPTION: Update to version 0.1-2.
382    
383            * man/TextRepository.Rd: Fixed bug in documentation.
384    
385    2007-01-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
386    
387            * DESCRIPTION: Update to version 0.1-1.
388    
389    2007-01-09  Ingo Feinerer  <h0125130@wu-wien.ac.at>
390    
391            * R/textdoccol.R (stemDoc): Use Rstem::wordStem instead of
392            wordStem.
393    
394    2007-01-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
395    
396            * R/: Changes due to Kurt's review.
397    
398    2006-12-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
399    
400            * R/: Implemented improvements based upon comments by David
401            Meyer.
402    
403    2006-12-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
404    
405            * inst/doc/: Rewrote vignette.
406    
407            * man/: Improved documentation.
408    
409    2006-12-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
410    
411            * man/: Updated documentation.
412    
413            * DESCRIPTION: Changed package name to "tm". Updated version to
414            0.1 for first CRAN release.
415    
416            * inst/texts/gmane.comp.lang.r.general.mbox: mbox Gmane R mailing
417            list archive example.
418    
419            * inst/texts/gmane.comp.lang.r.gr.rdf: RSS Gmane R mailing list
420            archive example.
421    
422            * R/preprocess.R (convert_mbox_eml): A simple e-mail converter
423            from (several mails per box) mbox format to (single mail per file)
424            eml format.
425    
426    2006-12-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
427    
428            * data/crude.rda: Rebuilt.
429    
430            * data/acq.rda: Rebuilt.
431    
432            * R/reader.R: Factored out reader and parser methods from
433            textdoccol.R.
434    
435            * R/source.R: Factored out Source methods from aobjects.R and
436            textdoccol.R.
437            (GmaneRSource): Encapsulates Gmane R mailing list archive RSS
438            feeds.
439    
440            * R/textdoccol.R (DirSource): Added support for recursive
441            traversal of directories.
442    
443    2006-12-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
444    
445            * R/textdoccol.R ([[): Loads the document corpus automatically
446            into memory upon access.
447            (tm_transform, tm_filter): Removed several checks whether the
448            document is already loaded ([[ ensures this now).
449            (gmane_r_reader): Reader for RSS feeds as provided by the Gmane R
450            mailing list archive.
451    
452    2006-12-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
453    
454            * R/aobjects.R (TextDocument): Is now a virtual class.
455            (Source): Is now a virtual class.
456    
457    2006-12-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
458    
459            * R/textdoccol.R (c): Support for an arbitrary number of document
460            collections.
461    
462    2006-11-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
463    
464            * R/textrepo.R: Updated TextRepository (constructor), append_elem,
465            append_meta and remove_meta.
466    
467            * R/textdoccol.R: Removed modify_metadata method.
468    
469            * R/textrepo.R: Removed modify_metadata method.
470    
471            * R/textdoccol.R (remove_meta): Supports removal of document
472            collection metadata and document (= in data frame) metadata.
473    
474    2006-11-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
475    
476            * R/textdoccol.R (append_doc): Bug fix for handling empty metadata.
477    
478            * data/crude.rda: Rebuilt.
479    
480            * data/acq.rda: Rebuilt.
481    
482            * inst/doc/textmin.Rnw: Updated vignette to reflect code changes.
483    
484            * R/textdoccol.R ([): Bug fix for subsetting a document
485            collection's data frame.
486    
487    2006-11-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
488    
489            * R/textdoccol.R: Bug fixes in s_filter. Added full query support
490            to s_filter.
491    
492            * R/textdoccol.R: Local text documents' metadata can now be copied
493            to a document collection's data frame with prescind_meta.
494    
495    2006-11-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
496    
497            * R/: Text documents' slot metadata is now accessible in s_filter.
498    
499            * R/: Rewrote s_filter function (has still some restrictions).
500    
501    2006-11-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
502    
503            * R/: Various fixes in handling metadata.
504    
505            * R/: Added update mechanism for text document collections.
506    
507    2006-11-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
508    
509            * R/: Merging of document collections now creates a binary tree
510            for reconstructing merged document collections.
511    
512            * R/: Redesign of metadata for document collections.
513    
514    2006-11-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
515    
516            * R/: Messages now use \code{ngettext}.
517    
518    2006-11-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
519    
520            * R/: Added functions for modifying and removing metadata.
521    
522    2006-11-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
523    
524            * man/: Updated some documentation.
525    
526            * R/: Corrected some connection issues.
527    
528            * inst/doc: Worked on the vignette.
529    
530    2006-10-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
531    
532            * inst/: Added texts and started vignette.
533    
534            * R/: Final changes based upon David's comments.
535    
536    2006-10-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
537    
538            * NAMESPACE: Corrected exports (generic methods need exportMethods
539            directives!).
540    
541    2006-10-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
542    
543            * R/: Modified the TextDocCol constructur and various parsers. It
544            is now modular and supports various file formats via plugins (see
545            the new "Source" class).
546    
547    2006-10-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
548    
549            * man/: Revised documentation after previous code changes.
550    
551    2006-10-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
552    
553            * R/: Remaining changes as discussed with David.
554    
555    2006-10-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
556    
557            * R/: Some changes as suggested by David. The rest will follow
558            within the next days.
559    
560  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
561    
562          * man/: Finished documentation.          * man/: Finished documentation.

Legend:
Removed from v.59  
changed lines
  Added in v.836

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge