SCM

SCM Repository

[tm] Diff of /pkg/ChangeLog
ViewVC logotype

Diff of /pkg/ChangeLog

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

trunk/R/textmin/ChangeLog revision 59, Tue Sep 26 12:24:09 2006 UTC trunk/tm/ChangeLog revision 832, Wed Mar 12 12:59:48 2008 UTC
# Line 1  Line 1 
1    2008-03-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
2    
3            * R/textdoccol.R (tmMap): Introduced lazy mapping.
4    
5            * R/source.R: Added VectorSource.
6    
7    2008-02-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
8    
9            * man/: Language codes should be in ISO 639-1 format.
10    
11            * R/textdoccol.R (asPlain): Preserve local meta data.
12    
13    2008-01-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
14    
15            * R/textdoccol.R (writeCorpus): Function for writing a corpus
16            containing plain text documents to disk.
17    
18    2008-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
19    
20            * R/termdocmatrix.R (TermDocMatrix): Ensure that dimnames are
21            always set correctly.
22    
23            * R/textdoccol.R: Set load = TRUE as default for load on demand
24            since in most cases this is the wanted behaviour.
25    
26    2008-01-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
27    
28            * R/: Renamed TextDocCol to Corpus, and Corpus to Content.
29    
30            * DESCRIPTION: Updated Version to 0.3 due to core name changes.
31    
32    2008-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
33    
34            * R/meta.R (meta): New function for consistent access to meta data
35            of document collections, repositories, and texts.
36    
37    2008-01-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
38    
39            * R/: Better support for encodings.
40    
41    2008-01-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
42    
43            * R/textdoccol.R (TextDocCol): Fixed bug regarding default reader
44            selection when no reader argument is given.
45    
46    2008-01-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
47    
48            * R/source.R (CSVSource): Now uses read.csv instead of scan
49            internally.
50    
51    2008-01-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
52    
53            * R/reader.R (getReaders): Returns available reader functions.
54    
55            * R/termdocmatrix.R (TermDocMatrix): Set new modular constructor
56            as default.
57    
58    2007-12-02  Ingo Feinerer  <h0125130@wu-wien.ac.at>
59    
60            * R/stopwords.R (stopwords): Shortened code, removed codetools
61            variable warnings.
62    
63            * man/: Documentation for showMeta, added an example for tmMap.
64    
65            * inst/doc/tm.Rnw: Updated vignette, comments on MS word reader,
66            some minor typos fixed.
67    
68    2007-12-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
69    
70            * R/aobjects.R (showMeta): Added method for pretty printing a
71            text document's meta data.
72    
73    2007-11-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
74    
75            * R/textdoccol.R (TextDocCol): Better handling of empty
76            arguments.
77    
78            * NAMESPACE: Exported readDOC.
79    
80            * man/completeStems.Rd: Added an example.
81    
82    2007-11-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
83    
84            * R/stopwords.R (stopwords): Look up .dat files at every
85            call. Allows users to modify stopword .dat files interactively.
86    
87    2007-11-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
88    
89            * R/termdocmatrix.R (termFreq): Correct processing of empty
90            documents.
91    
92    2007-10-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
93    
94            * man/: Updated documentation.
95    
96    2007-10-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
97    
98            * R/complete.R (completeStems): Completes (heuristically) word
99            stems.
100    
101            * R/termdocmatrix.R (TermDocMatrix2): New modular
102            constructor.
103    
104            * NAMESPACE: Exported termFreq.
105    
106    2007-10-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
107    
108            * R/reader.R (readDOC): Added MS Word reader (using antiword).
109    
110    2007-10-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
111    
112            * R/weight.R: Weighting functions for TermDocMatrix.
113    
114    2007-10-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
115    
116            * R/termdocmatrix.R (dimnames, colnames, rownames): Wrapper
117            functions for accessing dimension, column, and row names.
118    
119            * R/plot.R (plot.TermDocMatrix): Plot correlations between terms.
120    
121    2007-09-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
122    
123            * man/removePunctuation.Rd: Added documentation. Function also exported to NAMESPACE.
124    
125    2007-08-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
126    
127            * R/fungen.R: Use S4 class for function generators instead of S3 attributes.
128    
129    2007-07-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
130    
131            * R/reader.R (readPDF): Removed manual checks for pdftotext and
132            pdfinfo. The system call gives a warning anyway.
133    
134    2007-07-28  Ingo Feinerer  <h0125130@wu-wien.ac.at>
135    
136            * R/textdoccol.R (asPlain): Conversion from
137            StructuredTextDocuments to PlainTextDocuments.
138    
139    2007-07-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
140    
141            * R/termdocmatrix.R: Added convenience methods ("[", nrow, ncol)
142            for accessing term-document matrices.
143    
144            * inst/doc/tm.Rnw: readPDF is only called if pdftotext and pdfinfo
145            are installed.
146    
147    2007-07-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
148    
149            * R/termdocmatrix.R (TermDocMatrix): Improved efficiency. Kudos to
150            Christian Buchta.
151    
152    2007-07-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
153    
154            * inst/doc/tm.Rnw: Update vignette (readPDF, readHTML, preprocessReut21578XML).
155    
156    2007-07-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
157    
158            * R/reader.R (readHTML): Added very simple HTML reader to obtain StructuredTextDocuments.
159    
160            * R/reader.R (readPDF): Added PDF reader.
161    
162    2007-07-13  Ingo Feinerer  <h0125130@wu-wien.ac.at>
163    
164            * DESCRIPTION: Moved proxy from Depends to Imports to avoid name clashes.
165    
166            * inst/stopwords/english.dat: Added the term "yes" to stopwords.
167    
168            * R/termdocmatrix.R (dim): dim function for TermDocMatrix.
169    
170            * R/preprocess.R (convertMboxEml): Accepts gzipped mboxes.
171    
172    2007-07-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
173    
174            * R/distmeasure.R (dissimilarity): Replaced dists call from
175            package cba by new dist call from package proxy.
176    
177    2007-07-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
178    
179            * inst/doc/tm.Rnw: Described removeSparseTerms and Dictionary.
180    
181    2007-06-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
182    
183            * R/termdocmatrix.R: require() uses the quietly option to suppress
184            loading messages.
185    
186    2007-06-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
187    
188            * R/dictionary.R: Added dictionary support.
189    
190    2007-06-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
191    
192            * R/aobjects.R: Added classes for Reuters21578 XML and RCV1
193            documents. This simplifies some functions, e.g., asPlain.
194    
195    2007-06-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
196    
197            * inst/doc/tm.Rnw: Fixed some typos in vignette.
198    
199    2007-06-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
200    
201            * R/textdoccol.R (replaceWords): Added method to replace a set of
202            words by a single word. Useful for synonyms.
203    
204    2007-05-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
205    
206            * man/TermDocMatrix.Rd: Fixed documentation on Data slot.
207    
208    2007-05-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
209    
210            * R/termdocmatrix.R (textvector): Small fix for dealing with empty
211            vectors. Thanks to Ariel Maguyon for his error report.
212            (removeSparseTerms): New function to remove columns from a
213            term-document matrix exceeding a sparse factor.
214    
215    2007-05-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
216    
217            * man/tmUpdate.Rd: Corrected documentation on readerControl parameter.
218    
219    2007-05-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
220    
221            * man/sFilter.Rd: Corrected documentation on statement format (use
222            '==' instead of '=').
223    
224    2007-05-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
225    
226            * R/aobjects.R (StructuredTextDocument): Inherits from
227            TextDocument.
228    
229    2007-05-04  Ingo Feinerer  <h0125130@wu-wien.ac.at>
230    
231            * R/termdocmatrix.R (findFreqTerms): Perform efficient computation
232            on sparse matrices as proposed by Martin Maechler.
233    
234    2007-04-27  Ingo Feinerer  <h0125130@wu-wien.ac.at>
235    
236            * R/textdoccol.R: Removed \code{dbDisconnect} calls since last
237            \pkg{filehash} version makes them deprecated.
238    
239    2007-04-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
240    
241            * R/termdocmatrix.R (textvector): Stemming is now performed before
242            erasing stopwords.
243            (weightMatrix): Adapted to handle sparse matrices.
244            (TermDocMatrix): Sparse matrix is now efficiently built by
245            direct stepwise insertion of row values into it.
246    
247    2007-04-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
248    
249            * DESCRIPTION: Replaced \pkg{filehashSQLite} with \pkg{filehash}
250            due to ongoing problems. For our purposes the latter is as useful
251            as the replaced package.
252    
253    2007-04-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
254    
255            * man/TextDocCol.Rd: Replaced \code{readPlain} with \code{object@DefaultReader}.
256    
257            * man/TermDocMatrix.Rd: Remove deprecated \code{language} argument.
258    
259    2007-04-15  Ingo Feinerer  <h0125130@wu-wien.ac.at>
260    
261            * R/resolve.R (resolveISOCode): Added ISO 639-1 codes for
262            languages with available stopwords.
263    
264    2007-04-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
265    
266            * inst/doc/tm.Rnw: Minor corrections in the vignette.
267    
268    2007-04-11  Ingo Feinerer  <h0125130@wu-wien.ac.at>
269    
270            * DESCRIPTION: Update to version 0.2, since a lot of new features
271            have been integrated.
272    
273            * inst/stopwords: Updated existing stopwords and added stopwords
274            for various other languages.
275    
276    2007-04-10  Ingo Feinerer  <h0125130@wu-wien.ac.at>
277    
278            * man/: Updated documentation.
279    
280            * Work/testDb.R: Script to test database stuff.
281    
282            * R/: Fixed various database related bugs. Seems to be rather
283            useable now, i.e., consider as alpha status for now.
284    
285    2007-04-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
286    
287            * R/: Fixed some bugs related to database support.
288    
289    2007-04-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
290    
291            * man/: Added a lot of examples to the manuals.
292    
293    2007-04-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
294    
295            * man/: Updated parts of the documentation.
296    
297            * R/textdoccol.R (asPlain): Added conversion from newsgroup
298            documents to plain text documents.
299    
300    2007-04-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
301    
302            * R/textdoccol.R: Finished experimental database support. Not yet
303            intensively tested.
304    
305            * R/source.R: Now each source has a default reader.
306    
307            * R/reader.R: \code{FunctionGenerator} is now an attribute, not a
308            class anymore.
309    
310            * R/plaintextdoc.R: Custom show method for plain text documents.
311    
312            * R/aobjects.R: Added a class for structured text documents.
313    
314            * R/reader.R: Replaced remaining \code{parser} occurrences with
315            \code{reader}.
316    
317            * R/textdoccol.R (summary): Indent tags.
318    
319            * R/textdoccol.R (removePunctuation): Transform method to remove
320            punctuation marks.
321    
322    2007-03-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
323    
324            * R/textdoccol.R (sFilter): Simplified sFilter significantly by
325            using prescindMeta().
326    
327    2007-03-18  Ingo Feinerer  <h0125130@wu-wien.ac.at>
328    
329            * R/textdoccol.R: Improved database support.
330    
331    2007-03-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
332    
333            * R/termdocmatrix.R (TermDocMatrix): Uses sparse matrices.
334    
335            * R/resolve.R (resolveISOcode): Extracts the language from a ISO
336            language code.
337    
338            * R/textdoccol.R (TextDocCol): Refactored several parser arguments
339            into parserControl argument.
340    
341            * R/aobjects.R (TextDocument): Introduced the "Language" slot.
342    
343    2007-03-14  Ingo Feinerer  <h0125130@wu-wien.ac.at>
344    
345            * Work/tmDataSetup.R: The datasets acq and crude can now be
346            created on the fly.
347    
348            * R/stopwords.R: Introduced a function returning the stopwords for
349            a given language (English, German and French at the moment)
350    
351            * R/textdoccol.R (stemDoc): Stemming uses Rstem if available,
352            otherwise falls back to Snowball package.
353    
354    2007-01-30  Ingo Feinerer  <h0125130@wu-wien.ac.at>
355    
356            * man/dissimilarity-methods.Rd: Make clear that any method offered
357            by "dists" from package "cba" can be used.
358    
359    2007-01-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
360    
361            * inst/doc/tm.Rnw: Fixed quotes-appearing-as-boxes-bug according
362            to Kurt's latex suggestion. Removed points and underscores in
363            variable names for consistent naming.
364    
365            * DESCRIPTION: Update to version 0.1-2.
366    
367            * man/TextRepository.Rd: Fixed bug in documentation.
368    
369    2007-01-12  Ingo Feinerer  <h0125130@wu-wien.ac.at>
370    
371            * DESCRIPTION: Update to version 0.1-1.
372    
373    2007-01-09  Ingo Feinerer  <h0125130@wu-wien.ac.at>
374    
375            * R/textdoccol.R (stemDoc): Use Rstem::wordStem instead of
376            wordStem.
377    
378    2007-01-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
379    
380            * R/: Changes due to Kurt's review.
381    
382    2006-12-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
383    
384            * R/: Implemented improvements based upon comments by David
385            Meyer.
386    
387    2006-12-17  Ingo Feinerer  <h0125130@wu-wien.ac.at>
388    
389            * inst/doc/: Rewrote vignette.
390    
391            * man/: Improved documentation.
392    
393    2006-12-16  Ingo Feinerer  <h0125130@wu-wien.ac.at>
394    
395            * man/: Updated documentation.
396    
397            * DESCRIPTION: Changed package name to "tm". Updated version to
398            0.1 for first CRAN release.
399    
400            * inst/texts/gmane.comp.lang.r.general.mbox: mbox Gmane R mailing
401            list archive example.
402    
403            * inst/texts/gmane.comp.lang.r.gr.rdf: RSS Gmane R mailing list
404            archive example.
405    
406            * R/preprocess.R (convert_mbox_eml): A simple e-mail converter
407            from (several mails per box) mbox format to (single mail per file)
408            eml format.
409    
410    2006-12-08  Ingo Feinerer  <h0125130@wu-wien.ac.at>
411    
412            * data/crude.rda: Rebuilt.
413    
414            * data/acq.rda: Rebuilt.
415    
416            * R/reader.R: Factored out reader and parser methods from
417            textdoccol.R.
418    
419            * R/source.R: Factored out Source methods from aobjects.R and
420            textdoccol.R.
421            (GmaneRSource): Encapsulates Gmane R mailing list archive RSS
422            feeds.
423    
424            * R/textdoccol.R (DirSource): Added support for recursive
425            traversal of directories.
426    
427    2006-12-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
428    
429            * R/textdoccol.R ([[): Loads the document corpus automatically
430            into memory upon access.
431            (tm_transform, tm_filter): Removed several checks whether the
432            document is already loaded ([[ ensures this now).
433            (gmane_r_reader): Reader for RSS feeds as provided by the Gmane R
434            mailing list archive.
435    
436    2006-12-06  Ingo Feinerer  <h0125130@wu-wien.ac.at>
437    
438            * R/aobjects.R (TextDocument): Is now a virtual class.
439            (Source): Is now a virtual class.
440    
441    2006-12-05  Ingo Feinerer  <h0125130@wu-wien.ac.at>
442    
443            * R/textdoccol.R (c): Support for an arbitrary number of document
444            collections.
445    
446    2006-11-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
447    
448            * R/textrepo.R: Updated TextRepository (constructor), append_elem,
449            append_meta and remove_meta.
450    
451            * R/textdoccol.R: Removed modify_metadata method.
452    
453            * R/textrepo.R: Removed modify_metadata method.
454    
455            * R/textdoccol.R (remove_meta): Supports removal of document
456            collection metadata and document (= in data frame) metadata.
457    
458    2006-11-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
459    
460            * R/textdoccol.R (append_doc): Bug fix for handling empty metadata.
461    
462            * data/crude.rda: Rebuilt.
463    
464            * data/acq.rda: Rebuilt.
465    
466            * inst/doc/textmin.Rnw: Updated vignette to reflect code changes.
467    
468            * R/textdoccol.R ([): Bug fix for subsetting a document
469            collection's data frame.
470    
471    2006-11-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
472    
473            * R/textdoccol.R: Bug fixes in s_filter. Added full query support
474            to s_filter.
475    
476            * R/textdoccol.R: Local text documents' metadata can now be copied
477            to a document collection's data frame with prescind_meta.
478    
479    2006-11-21  Ingo Feinerer  <h0125130@wu-wien.ac.at>
480    
481            * R/: Text documents' slot metadata is now accessible in s_filter.
482    
483            * R/: Rewrote s_filter function (has still some restrictions).
484    
485    2006-11-20  Ingo Feinerer  <h0125130@wu-wien.ac.at>
486    
487            * R/: Various fixes in handling metadata.
488    
489            * R/: Added update mechanism for text document collections.
490    
491    2006-11-19  Ingo Feinerer  <h0125130@wu-wien.ac.at>
492    
493            * R/: Merging of document collections now creates a binary tree
494            for reconstructing merged document collections.
495    
496            * R/: Redesign of metadata for document collections.
497    
498    2006-11-07  Ingo Feinerer  <h0125130@wu-wien.ac.at>
499    
500            * R/: Messages now use \code{ngettext}.
501    
502    2006-11-03  Ingo Feinerer  <h0125130@wu-wien.ac.at>
503    
504            * R/: Added functions for modifying and removing metadata.
505    
506    2006-11-01  Ingo Feinerer  <h0125130@wu-wien.ac.at>
507    
508            * man/: Updated some documentation.
509    
510            * R/: Corrected some connection issues.
511    
512            * inst/doc: Worked on the vignette.
513    
514    2006-10-31  Ingo Feinerer  <h0125130@wu-wien.ac.at>
515    
516            * inst/: Added texts and started vignette.
517    
518            * R/: Final changes based upon David's comments.
519    
520    2006-10-29  Ingo Feinerer  <h0125130@wu-wien.ac.at>
521    
522            * NAMESPACE: Corrected exports (generic methods need exportMethods
523            directives!).
524    
525    2006-10-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
526    
527            * R/: Modified the TextDocCol constructur and various parsers. It
528            is now modular and supports various file formats via plugins (see
529            the new "Source" class).
530    
531    2006-10-24  Ingo Feinerer  <h0125130@wu-wien.ac.at>
532    
533            * man/: Revised documentation after previous code changes.
534    
535    2006-10-23  Ingo Feinerer  <h0125130@wu-wien.ac.at>
536    
537            * R/: Remaining changes as discussed with David.
538    
539    2006-10-22  Ingo Feinerer  <h0125130@wu-wien.ac.at>
540    
541            * R/: Some changes as suggested by David. The rest will follow
542            within the next days.
543    
544  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>  2006-09-26  Ingo Feinerer  <h0125130@wu-wien.ac.at>
545    
546          * man/: Finished documentation.          * man/: Finished documentation.

Legend:
Removed from v.59  
changed lines
  Added in v.832

root@r-forge.r-project.org
ViewVC Help
Powered by ViewVC 1.0.0  
Thanks to:
Vienna University of Economics and Business Powered By FusionForge