NetBeans Forums

 FAQFAQ   SearchSearch   MemberlistMemberlist   RegisterRegister   ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 
  

Dismal performance with large project

 
Post new topic   Reply to topic    NetBeans Forums -> NetBeans Users
View previous topic :: View next topic  
Author Message
iboyd



Joined: 29 Jul 2009
Posts: 5

PostPosted: Wed Jul 29, 2009 7:08 pm    Post subject: Dismal performance with large project Reply with quote

I have a large project (30k+ files, haven't counted the classes yet). The performance is dismal. Opening the largest class I've yet found (18k lines, 1200 or so methods) is measured in minutes. CPU usage can run as high as 99%, from the memory tool bar heap usage runs around 900m/1g.

my netbeans_default_options:


Code:
netbeans_default_options="-J-Dorg.glassfish.v3.installRoot=\"C:\Program Files\sges-v3-prelude\" -J-Dcom.sun.aas.installRoot=\"C:\Sun\AppServer\" -J-client -J-Xss2m -J-Xms1g -J-Xmx1g -J-XX:PermSize=32m -J-XX:MaxPermSize=200m -J-Xverify:none -J-Dapple.laf.useScreenMenuBar=true -J-Dsun.java2d.noddraw=true -J-XX:+UseConcMarkSweepGC -J-XX:+CMSClassUnloadingEnabled -J-XX:+CMSPermGenSweepingEnabled"


my project.xml:

Code:
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://www.netbeans.org/ns/project/1">
    <type>org.netbeans.modules.ant.freeform</type>
    <configuration>
        <general-data xmlns="http://www.netbeans.org/ns/freeform-project/1">
            <name>Task2009UIProjectBranch</name>
        </general-data>
        <general-data xmlns="http://www.netbeans.org/ns/freeform-project/2">
            <!-- Do not use Project Properties customizer when editing this file manually. -->
            <name>Task2009UIProjectBranch</name>
            <properties>
                <property name="project.dir">C:\code\branches\Task2009UIProjectBranch\iqxchange\frontoffice</property>
                <property name="weblogic.home">C:\bea</property>
                <property name="ant.script">${project.dir}/build.xml</property>
            </properties>
            <folders>
                <source-folder>
                    <label>frontoffice</label>
                    <location>${project.dir}</location>
                </source-folder>
                <source-folder>
                    <label>frontoffice</label>
                    <location>.</location>
                    <encoding>UTF-8</encoding>
                </source-folder>
                <source-folder>
                    <label>web</label>
                    <type>doc_root</type>
                    <location>src/j2ee_app/web</location>
                </source-folder>
                <source-folder>
                    <label>WEB-INF</label>
                    <type>web_inf</type>
                    <location>src/j2ee_app/web/WEB-INF</location>
                </source-folder>
                <source-folder>
                    <label>test\java</label>
                    <type>java</type>
                    <location>${project.dir}/test/java</location>
                    <encoding>UTF-8</encoding>
                </source-folder>
                <source-folder>
                    <label>src\java</label>
                    <type>java</type>
                    <location>${project.dir}/src/java</location>
                    <encoding>UTF-8</encoding>
                </source-folder>
                <source-folder>
                    <label>src\Common\src</label>
                    <type>java</type>
                    <location>${project.dir}/src/Common/src</location>
                    <encoding>UTF-8</encoding>
                </source-folder>
                <source-folder>
                    <label>src\Documents\src</label>
                    <type>java</type>
                    <location>${project.dir}/src/Documents/src</location>
                    <encoding>UTF-8</encoding>
                </source-folder>
                <source-folder>
                    <label>src\FO-Shared\Services</label>
                    <type>java</type>
                    <location>${project.dir}/src/FO-Shared/Services</location>
                    <encoding>UTF-8</encoding>
                </source-folder>
            </folders>
            <ide-actions>
                <action name="build">
                    <script>nbproject/nbjdk.xml</script>
                    <target>compile</target>
                </action>
                <action name="clean">
                    <script>nbproject/nbjdk.xml</script>
                    <target>clean</target>
                </action>
                <action name="javadoc">
                    <script>nbproject/nbjdk.xml</script>
                    <target>javadoc</target>
                </action>
                <action name="run">
                    <script>nbproject/nbjdk.xml</script>
                    <target>start.adminserver</target>
                </action>
                <action name="test">
                    <script>nbproject/nbjdk.xml</script>
                    <target>test</target>
                </action>
                <action name="redeploy">
                    <script>nbproject/nbjdk.xml</script>
                    <target>deploy.application</target>
                </action>
                <action name="rebuild">
                    <script>nbproject/nbjdk.xml</script>
                    <target>clean.domains</target>
                    <target>compile</target>
                </action>
                <action name="run.single">
                    <script>nbproject/nbjdk.xml</script>
                    <target>run-selected-file-in-java</target>
                    <context>
                        <property>run.class</property>
                        <folder>${project.dir}/src/java</folder>
                        <pattern>\.java$</pattern>
                        <format>java-name</format>
                        <arity>
                            <one-file-only/>
                        </arity>
                    </context>
                </action>
                <action name="compile.single">
                    <script>nbproject/nbjdk.xml</script>
                    <target>compile-selected-files-in-java</target>
                    <context>
                        <property>files</property>
                        <folder>${project.dir}/src/java</folder>
                        <pattern>\.java$</pattern>
                        <format>relative-path</format>
                        <arity>
                            <separated-files>,</separated-files>
                        </arity>
                    </context>
                </action>
            </ide-actions>
            <export>
                <type>folder</type>
                <location>${project.dir}/package/FO-Shared/APP-INF/classes</location>
                <script>nbproject/nbjdk.xml</script>
                <build-target>compile</build-target>
            </export>
            <export>
                <type>folder</type>
                <location>${project.dir}/package/FO-Shared/APP-INF/classes</location>
                <script>nbproject/nbjdk.xml</script>
                <build-target>compile</build-target>
            </export>
            <export>
                <type>folder</type>
                <location>${project.dir}/package/Common</location>
                <script>nbproject/nbjdk.xml</script>
                <build-target>compile</build-target>
            </export>
            <export>
                <type>folder</type>
                <location>${project.dir}/package/FO-Shared/APP-INF/classes</location>
                <script>nbproject/nbjdk.xml</script>
                <build-target>compile</build-target>
            </export>
            <view>
                <items>
                    <source-folder style="tree">
                        <label>Web Pages</label>
                        <location>src/j2ee_app/web</location>
                    </source-folder>
                    <source-folder style="tree">
                        <label>WEB-INF Content</label>
                        <location>src/j2ee_app/web/WEB-INF</location>
                    </source-folder>
                    <source-folder style="packages">
                        <label>test\java</label>
                        <location>${project.dir}/test/java</location>
                    </source-folder>
                    <source-folder style="packages">
                        <label>src\java</label>
                        <location>${project.dir}/src/java</location>
                    </source-folder>
                    <source-folder style="packages">
                        <label>src\Common\src</label>
                        <location>${project.dir}/src/Common/src</location>
                    </source-folder>
                    <source-folder style="packages">
                        <label>src\Documents\src</label>
                        <location>${project.dir}/src/Documents/src</location>
                    </source-folder>
                    <source-folder style="packages">
                        <label>src\FO-Shared\Services</label>
                        <location>${project.dir}/src/FO-Shared/Services</location>
                    </source-folder>
                    <source-file>
                        <location>${ant.script}</location>
                    </source-file>
                </items>
                <context-menu>
                    <ide-action name="build"/>
                    <ide-action name="rebuild"/>
                    <ide-action name="clean"/>
                    <ide-action name="javadoc"/>
                    <ide-action name="run"/>
                    <ide-action name="redeploy"/>
                    <ide-action name="test"/>
                </context-menu>
            </view>
            <subprojects>
                <project>.</project>
            </subprojects>
        </general-data>
        <java-data xmlns="http://www.netbeans.org/ns/freeform-project-java/2">
            <compilation-unit>
                <package-root>${project.dir}/test/java</package-root>
                <unit-tests/>
                <classpath mode="compile">lib/junit.jar;lib/toplink.jar;C:\bea/weblogic92/server/lib/weblogic.jar;lib/xstream.jar;lib/system-classpath/log4j.jar;lib/bcprov-jdk14-131.jar;lib/xmlsec.jar;lib/xalan.jar;lib/unittest/easymock.jar;lib/unittest/easymockclassextension.jar;lib/unittest/servertestcase.jar;lib/unittest/spring-mock.jar;lib/unittest/TestRunnerSession.jar;lib/unittest/xmlunit.jar;build/java;lib/edtftpj-pro.jar;lib/Csv2XmlFilter.jar;lib/axis.jar;C:\bea/weblogic92/server/lib/webservices.jar;lib/myfaces-api-1.1.6.jar;lib/myfaces-impl-1.1.6.jar;build/client/Accenture.jar;build/client/HomeDepot.jar;build/client/Kelly.jar;build/client/Labman.jar;build/client/ProjectInsight.jar;build/client/StaffTrackClient.jar;build/client/IQNClientWS.jar;lib/wicket-1.3.6.jar;lib/wicket-datetime-1.3.6.jar;lib/wicket-extensions-1.3.6.jar;lib/wicketstuff-scriptaculous-1.3-20080419.040255-14.jar</classpath>
                <built-to>${project.dir}/package/FO-Shared/APP-INF/classes</built-to>
                <source-level>1.5</source-level>
            </compilation-unit>
            <compilation-unit>
                <package-root>${project.dir}/src/java</package-root>
                <classpath mode="compile">C:\bea/weblogic92/server/lib/weblogic.jar;C:\bea/weblogic92/server/lib/ojdbc14.jar;C:\bea/weblogic92/server/lib/webservices.jar;../../../../Java/apis/ant-1.7.1/lib/ant.jar;lib/axis-ant.jar;lib/axis.jar;lib/bcprov-jdk14-131.jar;lib/cglib-nodep-2.1_3.jar;lib/commons-beanutils.jar;lib/commons-codec-1.3.jar;lib/commons-collections-3.2.jar;lib/commons-digester-1.8.jar;lib/commons-discovery-0.2.jar;lib/commons-el-1.0.jar;lib/commons-fileupload-1.2.jar;lib/commons-io-1.4.jar;lib/commons-lang-2.1.jar;lib/commons-logging.jar;lib/commons-validator.jar;lib/commons-vfs-1.0-dev.jar;lib/cos.jar;lib/Csv2XmlFilter.jar;lib/dm.jar;lib/dom4j-1.6.1.jar;lib/dwr.jar;lib/edtftpj-pro.jar;lib/http.jar;lib/jazzy-core-compiled-w-j2se1.4.2_05.jar;lib/jcommon-1.0.0.jar;lib/jfreechart-1.0.1.jar;lib/jsch-0.1.16.jar;lib/jstl.jar;lib/junit.jar;lib/license.jar;lib/memorydebuggerAPI.jar;lib/spring.jar;lib/standard.jar;lib/toplink.jar;lib/velocity-1.3-dev.jar;lib/wsdl4j.jar;lib/xalan.jar;lib/xmlsec.jar;lib/xstream.jar;lib/system-classpath/log4j.jar;lib/myfaces-api-1.1.6.jar;lib/myfaces-impl-1.1.6.jar;lib/richfaces-api-3.1.6.GA.jar;lib/richfaces-impl-3.1.6.GA.jar;lib/richfaces-ui-3.1.6.GA.jar;lib/shale-core-1.0.3.jar;lib/tomahawk-1.1.7.jar;lib/common-annotations.jar;lib/el-api.jar;lib/el-impl.jar;lib/jsf-facelets.jar;build/client/Accenture.jar;build/client/HomeDepot.jar;build/client/Kelly.jar;build/client/Labman.jar;build/client/ProjectInsight.jar;build/client/StaffTrackClient.jar;package/Common;package/FO-Shared/APP-INF/classes;build/java;lib/json_simple-1.1.jar;lib/wicket-1.3.6.jar;lib/wicket-datetime-1.3.6.jar;lib/wicket-extensions-1.3.6.jar;lib/wicketstuff-scriptaculous-1.3-20080419.040255-14.jar</classpath>
                <built-to>${project.dir}/package/FO-Shared/APP-INF/classes</built-to>
                <source-level>1.5</source-level>
            </compilation-unit>
            <compilation-unit>
                <package-root>${project.dir}/src/Common/src</package-root>
                <classpath mode="compile">${project.dir}/lib/system-classpath/log4j.jar;${project.dir}/package/FO-Shared/APP-INF/classes;${weblogic.home}/weblogic92/server/lib/weblogic.jar;${project.dir}/lib/cos.jar</classpath>
                <built-to>${project.dir}/package/Common</built-to>
                <source-level>1.5</source-level>
            </compilation-unit>
            <compilation-unit>
                <package-root>${project.dir}/src/Documents/src</package-root>
                <classpath mode="compile">${project.dir}/lib/junit.jar;${project.dir}/lib/toplink.jar;${project.dir}/lib/system-classpath/log4j.jar</classpath>
                <built-to>${project.dir}/package/FO-Shared/APP-INF/classes</built-to>
                <source-level>1.5</source-level>
            </compilation-unit>
            <compilation-unit>
                <package-root>${project.dir}/src/FO-Shared/Services</package-root>
                <classpath mode="compile">${weblogic.home}\weblogic92\server\lib\weblogic.jar;${project.dir}/lib/system-classpath/log4j.jar;${project.dir}/build/java</classpath>
                <source-level>1.5</source-level>
            </compilation-unit>
        </java-data>
        <preferences xmlns="http://www.netbeans.org/ns/auxiliary-configuration-preferences/1">
            <module name="org-netbeans-modules-editor-indent"/>
        </preferences>
        <web-data xmlns="http://www.netbeans.org/ns/freeform-project-web/1">
            <web-module>
                <doc-root>src/j2ee_app/web</doc-root>
                <classpath/>
                <context-path>/MainServlet</context-path>
                <j2ee-spec-level>1.5</j2ee-spec-level>
            </web-module>
        </web-data>
    </configuration>
</project>


Any suggestions on how to improve this? It is currently unusable.
Back to top
Thomas Wolf
Posted via mailing list.





PostPosted: Wed Jul 29, 2009 7:20 pm    Post subject: Dismal performance with large project Reply with quote

You didn't tell us what version of NB you're running. 6.7.1 has quite a
few performance-related fixes but if you're already running that...

tom


On 07/29/2009 03:09 PM, iboyd wrote:
Quote:
I have a large project (30k+ files, haven't counted the classes yet). The performance is dismal. Opening the largest class I've yet found (18k lines, 1200 or so methods) is measured in minutes. CPU usage can run as high as 99%, from the memory tool bar heap usage runs around 900m/1g.



my netbeans_default_options:






Code:
netbeans_default_options="-J-Dorg.glassfish.v3.installRoot=\"C:\Program Files\sges-v3-prelude\" -J-Dcom.sun.aas.installRoot=\"C:\Sun\AppServer\" -J-client -J-Xss2m -J-Xms1g -J-Xmx1g -J-XX:PermSize=32m -J-XX:MaxPermSize=200m -J-Xverify:none -J-Dapple.laf.useScreenMenuBar=true -J-Dsun.java2d.noddraw=true -J-XX:+UseConcMarkSweepGC -J-XX:+CMSClassUnloadingEnabled -J-XX:+CMSPermGenSweepingEnabled"







my project.xml:




Code:
<?xml version="1.0" encoding="UTF-8"?>

<project xmlns="http://www.netbeans.org/ns/project/1">

<type>org.netbeans.modules.ant.freeform</type>

<configuration>

<general-data xmlns="http://www.netbeans.org/ns/freeform-project/1">

<name>Task2009UIProjectBranch</name>

</general-data>

<general-data xmlns="http://www.netbeans.org/ns/freeform-project/2">

<!-- Do not use Project Properties customizer when editing this file manually. -->

<name>Task2009UIProjectBranch</name>

<properties>

<property name="project.dir">C:\code\branches\Task2009UIProjectBranch\iqxchange\frontoffice</property>

<property name="weblogic.home">C:\bea</property>

<property name="ant.script">${project.dir}/build.xml</property>

</properties>

<folders>

<source-folder>

<label>frontoffice</label>

<location>${project.dir}</location>

</source-folder>

<source-folder>

<label>frontoffice</label>

<location>.</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>web</label>

<type>doc_root</type>

<location>src/j2ee_app/web</location>

</source-folder>

<source-folder>

<label>WEB-INF</label>

<type>web_inf</type>

<location>src/j2ee_app/web/WEB-INF</location>

</source-folder>

<source-folder>

<label>test\java</label>

<type>java</type>

<location>${project.dir}/test/java</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>src\java</label>

<type>java</type>

<location>${project.dir}/src/java</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>src\Common\src</label>

<type>java</type>

<location>${project.dir}/src/Common/src</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>src\Documents\src</label>

<type>java</type>

<location>${project.dir}/src/Documents/src</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>src\FO-Shared\Services</label>

<type>java</type>

<location>${project.dir}/src/FO-Shared/Services</location>

<encoding>UTF-8</encoding>

</source-folder>

</folders>

<ide-actions>

<action name="build">

<script>nbproject/nbjdk.xml</script>

<target>compile</target>

</action>

<action name="clean">

<script>nbproject/nbjdk.xml</script>

<target>clean</target>

</action>

<action name="javadoc">

<script>nbproject/nbjdk.xml</script>

<target>javadoc</target>

</action>

<action name="run">

<script>nbproject/nbjdk.xml</script>

<target>start.adminserver</target>

</action>

<action name="test">

<script>nbproject/nbjdk.xml</script>

<target>test</target>

</action>

<action name="redeploy">

<script>nbproject/nbjdk.xml</script>

<target>deploy.application</target>

</action>

<action name="rebuild">

<script>nbproject/nbjdk.xml</script>

<target>clean.domains</target>

<target>compile</target>

</action>

<action name="run.single">

<script>nbproject/nbjdk.xml</script>

<target>run-selected-file-in-java</target>

<context>

<property>run.class</property>

<folder>${project.dir}/src/java</folder>

<pattern>\.java$</pattern>

<format>java-name</format>

<arity>

<one-file-only/>

</arity>

</context>

</action>

<action name="compile.single">

<script>nbproject/nbjdk.xml</script>

<target>compile-selected-files-in-java</target>

<context>

<property>files</property>

<folder>${project.dir}/src/java</folder>

<pattern>\.java$</pattern>

<format>relative-path</format>

<arity>

<separated-files>,</separated-files>

</arity>

</context>

</action>

</ide-actions>

<export>

<type>folder</type>

<location>${project.dir}/package/FO-Shared/APP-INF/classes</location>

<script>nbproject/nbjdk.xml</script>

<build-target>compile</build-target>

</export>

<export>

<type>folder</type>

<location>${project.dir}/package/FO-Shared/APP-INF/classes</location>

<script>nbproject/nbjdk.xml</script>

<build-target>compile</build-target>

</export>

<export>

<type>folder</type>

<location>${project.dir}/package/Common</location>

<script>nbproject/nbjdk.xml</script>

<build-target>compile</build-target>

</export>

<export>

<type>folder</type>

<location>${project.dir}/package/FO-Shared/APP-INF/classes</location>

<script>nbproject/nbjdk.xml</script>

<build-target>compile</build-target>

</export>

<view>

<items>

<source-folder style="tree">

<label>Web Pages</label>

<location>src/j2ee_app/web</location>

</source-folder>

<source-folder style="tree">

<label>WEB-INF Content</label>

<location>src/j2ee_app/web/WEB-INF</location>

</source-folder>

<source-folder style="packages">

<label>test\java</label>

<location>${project.dir}/test/java</location>

</source-folder>

<source-folder style="packages">

<label>src\java</label>

<location>${project.dir}/src/java</location>

</source-folder>

<source-folder style="packages">

<label>src\Common\src</label>

<location>${project.dir}/src/Common/src</location>

</source-folder>

<source-folder style="packages">

<label>src\Documents\src</label>

<location>${project.dir}/src/Documents/src</location>

</source-folder>

<source-folder style="packages">

<label>src\FO-Shared\Services</label>

<location>${project.dir}/src/FO-Shared/Services</location>

</source-folder>

<source-file>

<location>${ant.script}</location>

</source-file>

</items>

<context-menu>

<ide-action name="build"/>

<ide-action name="rebuild"/>

<ide-action name="clean"/>

<ide-action name="javadoc"/>

<ide-action name="run"/>

<ide-action name="redeploy"/>

<ide-action name="test"/>

</context-menu>

</view>

<subprojects>

<project>.</project>

</subprojects>

</general-data>

<java-data xmlns="http://www.netbeans.org/ns/freeform-project-java/2">

<compilation-unit>

<package-root>${project.dir}/test/java</package-root>

<unit-tests/>

<classpath mode="compile">lib/junit.jar;lib/toplink.jar;C:\bea/weblogic92/server/lib/weblogic.jar;lib/xstream.jar;lib/system-classpath/log4j.jar;lib/bcprov-jdk14-131.jar;lib/xmlsec.jar;lib/xalan.jar;lib/unittest/easymock.jar;lib/unittest/easymockclassextension.jar;lib/unittest/servertestcase.jar;lib/unittest/spring-mock.jar;lib/unittest/TestRunnerSession.jar;lib/unittest/xmlunit.jar;build/java;lib/edtftpj-pro.jar;lib/Csv2XmlFilter.jar;lib/axis.jar;C:\bea/weblogic92/server/lib/webservices.jar;lib/myfaces-api-1.1.6.jar;lib/myfaces-impl-1.1.6.jar;build/client/Accenture.jar;build/client/HomeDepot.jar;build/client/Kelly.jar;build/client/Labman.jar;build/client/ProjectInsight.jar;build/client/StaffTrackClient.jar;build/client/IQNClientWS.jar;lib/wicket-1.3.6.jar;lib/wicket-datetime-1.3.6.jar;lib/wicket-extensions-1.3.6.jar;lib/wicketstuff-scriptaculous-1.3-20080419.040255-14.jar</classpath>

<built-to>${project.dir}/package/FO-Shared/APP-INF/classes</built-to>

<source-level>1.5</source-level>

</compilation-unit>

<compilation-unit>

<package-root>${project.dir}/src/java</package-root>

<classpath mode="compile">C:\bea/weblogic92/server/lib/weblogic.jar;C:\bea/weblogic92/server/lib/ojdbc14.jar;C:\bea/weblogic92/server/lib/webservices.jar;../../../../Java/apis/ant-1.7.1/lib/ant.jar;lib/axis-ant.jar;lib/axis.jar;lib/bcprov-jdk14-131.jar;lib/cglib-nodep-2.1_3.jar;lib/commons-beanutils.jar;lib/commons-codec-1.3.jar;lib/commons-collections-3.2.jar;lib/commons-digester-1.8.jar;lib/commons-discovery-0.2.jar;lib/commons-el-1.0.jar;lib/commons-fileupload-1.2.jar;lib/commons-io-1.4.jar;lib/commons-lang-2.1.jar;lib/commons-logging.jar;lib/commons-validator.jar;lib/commons-vfs-1.0-dev.jar;lib/cos.jar;lib/Csv2XmlFilter.jar;lib/dm.jar;lib/dom4j-1.6.1.jar;lib/dwr.jar;lib/edtftpj-pro.jar;lib/http.jar;lib/jazzy-core-compiled-w-j2se1.4.2_05.jar;lib/jcommon-1.0.0.jar;lib/jfreechart-1.0.1.jar;lib/jsch-0.1.16.jar;lib/jstl.jar;lib/junit.jar;lib/license.jar;lib/memorydebuggerAPI.jar;lib/spring.jar;lib/standard.jar;lib/toplink.jar;lib/velocity-1.3-dev.jar;lib/wsdl4j
.jar;lib/xalan.jar;lib/xmlsec.jar;lib/xstream.jar;lib/system-classpath/log4j.jar;lib/myfaces-api-1.1.6.jar;lib/myfaces-impl-1.1.6.jar;lib/richfaces-api-3.1.6.GA.jar;lib/richfaces-impl-3.1.6.GA.jar;lib/richfaces-ui-3.1.6.GA.jar;lib/shale-core-1.0.3.jar;lib/tomahawk-1.1.7.jar;lib/common-annotations.jar;lib/el-api.jar;lib/el-impl.jar;lib/jsf-facelets.jar;build/client/Accenture.jar;build/client/HomeDepot.jar;build/client/Kelly.jar;build/client/Labman.jar;build/client/ProjectInsight.jar;build/client/StaffTrackClient.jar;package/Common;package/FO-Shared/APP-INF/classes;build/java;lib/json_simple-1.1.jar;lib/wicket-1.3.6.jar;lib/wicket-datetime-1.3.6.jar;lib/wicket-extensions-1.3.6.jar;lib/wicketstuff-scriptaculous-1.3-20080419.040255-14.jar</classpath>

<built-to>${project.dir}/package/FO-Shared/APP-INF/classes</built-to>

<source-level>1.5</source-level>

</compilation-unit>

<compilation-unit>

<package-root>${project.dir}/src/Common/src</package-root>

<classpath mode="compile">${project.dir}/lib/system-classpath/log4j.jar;${project.dir}/package/FO-Shared/APP-INF/classes;${weblogic.home}/weblogic92/server/lib/weblogic.jar;${project.dir}/lib/cos.jar</classpath>

<built-to>${project.dir}/package/Common</built-to>

<source-level>1.5</source-level>

</compilation-unit>

<compilation-unit>

<package-root>${project.dir}/src/Documents/src</package-root>

<classpath mode="compile">${project.dir}/lib/junit.jar;${project.dir}/lib/toplink.jar;${project.dir}/lib/system-classpath/log4j.jar</classpath>

<built-to>${project.dir}/package/FO-Shared/APP-INF/classes</built-to>

<source-level>1.5</source-level>

</compilation-unit>

<compilation-unit>

<package-root>${project.dir}/src/FO-Shared/Services</package-root>

<classpath mode="compile">${weblogic.home}\weblogic92\server\lib\weblogic.jar;${project.dir}/lib/system-classpath/log4j.jar;${project.dir}/build/java</classpath>

<source-level>1.5</source-level>

</compilation-unit>

</java-data>

<preferences xmlns="http://www.netbeans.org/ns/auxiliary-configuration-preferences/1">

<module name="org-netbeans-modules-editor-indent"/>

</preferences>

<web-data xmlns="http://www.netbeans.org/ns/freeform-project-web/1">

<web-module>

<doc-root>src/j2ee_app/web</doc-root>

<classpath/>

<context-path>/MainServlet</context-path>

<j2ee-spec-level>1.5</j2ee-spec-level>

</web-module>

</web-data>

</configuration>

</project>







Any suggestions on how to improve this? It is currently unusable.





**********************************************************************************************
IMPORTANT: The contents of this email and any attachments are confidential. They are intended for the
named recipient(s) only.
If you have received this email in error, please notify the system manager or the sender immediately and do
not disclose the contents to anyone or make copies thereof.
*** eSafe scanned this email for viruses, vandals, and malicious content. ***
**********************************************************************************************
Back to top
iboyd



Joined: 29 Jul 2009
Posts: 5

PostPosted: Wed Jul 29, 2009 7:27 pm    Post subject: Reply with quote

Sorry,

Netbeans 6.7.1 on windows xp jdk 1.5.0_16 (trying that now, was using 1.6.0_14).

Just got a out of memory error, ran out of heap. One gig of heap. All used up with one file open, attempting to open another.
Back to top
Mike Riley
Posted via mailing list.





PostPosted: Wed Jul 29, 2009 11:43 pm    Post subject: Dismal performance with large project Reply with quote

Also which OS and how much memory on the system? Memory could be a limiting
factor for a large set of files, base on my experience.

Mike

Thomas Wolf wrote:
Quote:
You didn't tell us what version of NB you're running. 6.7.1 has quite a
few performance-related fixes but if you're already running that...

tom


On 07/29/2009 03:09 PM, iboyd wrote:
Quote:
I have a large project (30k+ files, haven't counted the classes yet).
The performance is dismal. Opening the largest class I've yet found
(18k lines, 1200 or so methods) is measured in minutes. CPU usage can
run as high as 99%, from the memory tool bar heap usage runs around
900m/1g.



my netbeans_default_options:






Code:
netbeans_default_options="-J-Dorg.glassfish.v3.installRoot=\"C:\Program
Files\sges-v3-prelude\"
-J-Dcom.sun.aas.installRoot=\"C:\Sun\AppServer\" -J-client -J-Xss2m
-J-Xms1g -J-Xmx1g -J-XX:PermSize=32m -J-XX:MaxPermSize=200m
-J-Xverify:none -J-Dapple.laf.useScreenMenuBar=true
-J-Dsun.java2d.noddraw=true -J-XX:+UseConcMarkSweepGC
-J-XX:+CMSClassUnloadingEnabled -J-XX:+CMSPermGenSweepingEnabled"







my project.xml:




Code:
<?xml version="1.0" encoding="UTF-8"?>

<project xmlns="http://www.netbeans.org/ns/project/1">

<type>org.netbeans.modules.ant.freeform</type>

<configuration>

<general-data
xmlns="http://www.netbeans.org/ns/freeform-project/1">

<name>Task2009UIProjectBranch</name>

</general-data>

<general-data
xmlns="http://www.netbeans.org/ns/freeform-project/2">

<!-- Do not use Project Properties customizer when
editing this file manually. -->

<name>Task2009UIProjectBranch</name>

<properties>

<property
name="project.dir">C:\code\branches\Task2009UIProjectBranch\iqxchange\frontoffice</property>


<property name="weblogic.home">C:\bea</property>

<property
name="ant.script">${project.dir}/build.xml</property>

</properties>

<folders>

<source-folder>

<label>frontoffice</label>

<location>${project.dir}</location>

</source-folder>

<source-folder>

<label>frontoffice</label>

<location>.</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>web</label>

<type>doc_root</type>

<location>src/j2ee_app/web</location>

</source-folder>

<source-folder>

<label>WEB-INF</label>

<type>web_inf</type>

<location>src/j2ee_app/web/WEB-INF</location>

</source-folder>

<source-folder>

<label>test\java</label>

<type>java</type>

<location>${project.dir}/test/java</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>src\java</label>

<type>java</type>

<location>${project.dir}/src/java</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>src\Common\src</label>

<type>java</type>

<location>${project.dir}/src/Common/src</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>src\Documents\src</label>

<type>java</type>


<location>${project.dir}/src/Documents/src</location>

<encoding>UTF-8</encoding>

</source-folder>

<source-folder>

<label>src\FO-Shared\Services</label>

<type>java</type>


<location>${project.dir}/src/FO-Shared/Services</location>

<encoding>UTF-8</encoding>

</source-folder>

</folders>

<ide-actions>

<action name="build">

<script>nbproject/nbjdk.xml</script>

<target>compile</target>

</action>

<action name="clean">

<script>nbproject/nbjdk.xml</script>

<target>clean</target>

</action>

<action name="javadoc">

<script>nbproject/nbjdk.xml</script>

<target>javadoc</target>

</action>

<action name="run">

<script>nbproject/nbjdk.xml</script>

<target>start.adminserver</target>

</action>

<action name="test">

<script>nbproject/nbjdk.xml</script>

<target>test</target>

</action>

<action name="redeploy">

<script>nbproject/nbjdk.xml</script>

<target>deploy.application</target>

</action>

<action name="rebuild">

<script>nbproject/nbjdk.xml</script>

<target>clean.domains</target>

<target>compile</target>

</action>

<action name="run.single">

<script>nbproject/nbjdk.xml</script>

<target>run-selected-file-in-java</target>

<context>

<property>run.class</property>

<folder>${project.dir}/src/java</folder>

<pattern>\.java$</pattern>

<format>java-name</format>

<arity>

<one-file-only/>

</arity>

</context>

</action>

<action name="compile.single">

<script>nbproject/nbjdk.xml</script>

<target>compile-selected-files-in-java</target>

<context>

<property>files</property>

<folder>${project.dir}/src/java</folder>

<pattern>\.java$</pattern>

<format>relative-path</format>

<arity>

<separated-files>,</separated-files>

</arity>

</context>

</action>

</ide-actions>

<export>

<type>folder</type>


<location>${project.dir}/package/FO-Shared/APP-INF/classes</location>

<script>nbproject/nbjdk.xml</script>

<build-target>compile</build-target>

</export>

<export>

<type>folder</type>


<location>${project.dir}/package/FO-Shared/APP-INF/classes</location>

<script>nbproject/nbjdk.xml</script>

<build-target>compile</build-target>

</export>

<export>

<type>folder</type>

<location>${project.dir}/package/Common</location>

<script>nbproject/nbjdk.xml</script>

<build-target>compile</build-target>

</export>

<export>

<type>folder</type>


<location>${project.dir}/package/FO-Shared/APP-INF/classes</location>

<script>nbproject/nbjdk.xml</script>

<build-target>compile</build-target>

</export>

<view>

<items>

<source-folder style="tree">

<label>Web Pages</label>

<location>src/j2ee_app/web</location>

</source-folder>

<source-folder style="tree">

<label>WEB-INF Content</label>

<location>src/j2ee_app/web/WEB-INF</location>

</source-folder>

<source-folder style="packages">

<label>test\java</label>

<location>${project.dir}/test/java</location>

</source-folder>

<source-folder style="packages">

<label>src\java</label>

<location>${project.dir}/src/java</location>

</source-folder>

<source-folder style="packages">

<label>src\Common\src</label>


<location>${project.dir}/src/Common/src</location>

</source-folder>

<source-folder style="packages">

<label>src\Documents\src</label>


<location>${project.dir}/src/Documents/src</location>

</source-folder>

<source-folder style="packages">

<label>src\FO-Shared\Services</label>


<location>${project.dir}/src/FO-Shared/Services</location>

</source-folder>

<source-file>

<location>${ant.script}</location>

</source-file>

</items>

<context-menu>

<ide-action name="build"/>

<ide-action name="rebuild"/>

<ide-action name="clean"/>

<ide-action name="javadoc"/>

<ide-action name="run"/>

<ide-action name="redeploy"/>

<ide-action name="test"/>

</context-menu>

</view>

<subprojects>

<project>.</project>

</subprojects>

</general-data>

<java-data
xmlns="http://www.netbeans.org/ns/freeform-project-java/2">

<compilation-unit>

<package-root>${project.dir}/test/java</package-root>

<unit-tests/>

<classpath
mode="compile">lib/junit.jar;lib/toplink.jar;C:\bea/weblogic92/server/lib/weblogic.jar;lib/xstream.jar;lib/system-classpath/log4j.jar;lib/bcprov-jdk14-131.jar;lib/xmlsec.jar;lib/xalan.jar;lib/unittest/easymock.jar;lib/unittest/easymockclassextension.jar;lib/unittest/servertestcase.jar;lib/unittest/spring-mock.jar;lib/unittest/TestRunnerSession.jar;lib/unittest/xmlunit.jar;build/java;lib/edtftpj-pro.jar;lib/Csv2XmlFilter.jar;lib/axis.jar;C:\bea/weblogic92/server/lib/webservices.jar;lib/myfaces-api-1.1.6.jar;lib/myfaces-impl-1.1.6.jar;build/client/Accenture.jar;build/client/HomeDepot.jar;build/client/Kelly.jar;build/client/Labman.jar;build/client/ProjectInsight.jar;build/client/StaffTrackClient.jar;build/client/IQNClientWS.jar;lib/wicket-1.3.6.jar;lib/wicket-datetime-1.3.6.jar;lib/wicket-extensions-1.3.6.jar;lib/wicketstuff-scriptaculous-1.3-20080419.040255-14.jar</classpath>



<built-to>${project.dir}/package/FO-Shared/APP-INF/classes</built-to>

<source-level>1.5</source-level>

</compilation-unit>

<compilation-unit>

<package-root>${project.dir}/src/java</package-root>

<classpath
mode="compile">C:\bea/weblogic92/server/lib/weblogic.jar;C:\bea/weblogic92/server/lib/ojdbc14.jar;C:\bea/weblogic92/server/lib/webservices.jar;../../../../Java/apis/ant-1.7.1/lib/ant.jar;lib/axis-ant.jar;lib/axis.jar;lib/bcprov-jdk14-131.jar;lib/cglib-nodep-2.1_3.jar;lib/commons-beanutils.jar;lib/commons-codec-1.3.jar;lib/commons-collections-3.2.jar;lib/commons-digester-1.8.jar;lib/commons-discovery-0.2.jar;lib/commons-el-1.0.jar;lib/commons-fileupload-1.2.jar;lib/commons-io-1.4.jar;lib/commons-lang-2.1.jar;lib/commons-logging.jar;lib/commons-validator.jar;lib/commons-vfs-1.0-dev.jar;lib/cos.jar;lib/Csv2XmlFilter.jar;lib/dm.jar;lib/dom4j-1.6.1.jar;lib/dwr.jar;lib/edtftpj-pro.jar;lib/http.jar;lib/jazzy-core-compiled-w-j2se1.4.2_05.jar;lib/jcommon-1.0.0.jar;lib/jfreechart-1.0.1.jar;lib/jsch-0.1.16.jar;lib/jstl.jar;lib/junit.jar;lib/license.jar;lib/memorydebuggerAPI.jar;lib/spring.jar;lib/standard.jar;lib/toplink.jar;lib/velocity-1.3-dev.jar;lib/wsdl4j


.jar;lib/xalan.jar;lib/xmlsec.jar;lib/xstream.jar;lib/system-classpath/log4j.jar;lib/myfaces-api-1.1.6.jar;lib/myfaces-impl-1.1.6.jar;lib/richfaces-api-3.1.6.GA.jar;lib/richfaces-impl-3.1.6.GA.jar;lib/richfaces-ui-3.1.6.GA.jar;lib/shale-core-1.0.3.jar;lib/tomahawk-1.1.7.jar;lib/common-annotations.jar;lib/el-api.jar;lib/el-impl.jar;lib/jsf-facelets.jar;build/client/Accenture.jar;build/client/HomeDepot.jar;build/client/Kelly.jar;build/client/Labman.jar;build/client/ProjectInsight.jar;build/client/StaffTrackClient.jar;package/Common;package/FO-Shared/APP-INF/classes;build/java;lib/json_simple-1.1.jar;lib/wicket-1.3.6.jar;lib/wicket-datetime-1.3.6.jar;lib/wicket-extensions-1.3.6.jar;lib/wicketstuff-scriptaculous-1.3-20080419.040255-14.jar</classpath>



<built-to>${project.dir}/package/FO-Shared/APP-INF/classes</built-to>

<source-level>1.5</source-level>

</compilation-unit>

<compilation-unit>


<package-root>${project.dir}/src/Common/src</package-root>

<classpath
mode="compile">${project.dir}/lib/system-classpath/log4j.jar;${project.dir}/package/FO-Shared/APP-INF/classes;${weblogic.home}/weblogic92/server/lib/weblogic.jar;${project.dir}/lib/cos.jar</classpath>


<built-to>${project.dir}/package/Common</built-to>

<source-level>1.5</source-level>

</compilation-unit>

<compilation-unit>


<package-root>${project.dir}/src/Documents/src</package-root>

<classpath
mode="compile">${project.dir}/lib/junit.jar;${project.dir}/lib/toplink.jar;${project.dir}/lib/system-classpath/log4j.jar</classpath>



<built-to>${project.dir}/package/FO-Shared/APP-INF/classes</built-to>

<source-level>1.5</source-level>

</compilation-unit>

<compilation-unit>


<package-root>${project.dir}/src/FO-Shared/Services</package-root>

<classpath
mode="compile">${weblogic.home}\weblogic92\server\lib\weblogic.jar;${project.dir}/lib/system-classpath/log4j.jar;${project.dir}/build/java</classpath>


<source-level>1.5</source-level>

</compilation-unit>

</java-data>

<preferences
xmlns="http://www.netbeans.org/ns/auxiliary-configuration-preferences/1">

<module name="org-netbeans-modules-editor-indent"/>

</preferences>

<web-data
xmlns="http://www.netbeans.org/ns/freeform-project-web/1">

<web-module>

<doc-root>src/j2ee_app/web</doc-root>

<classpath/>

<context-path>/MainServlet</context-path>

<j2ee-spec-level>1.5</j2ee-spec-level>

</web-module>

</web-data>

</configuration>

</project>







Any suggestions on how to improve this? It is currently unusable.
Back to top
iboyd



Joined: 29 Jul 2009
Posts: 5

PostPosted: Wed Jul 29, 2009 11:51 pm    Post subject: Reply with quote

windows xp, 4G memory
Back to top
tkellerer



Joined: 15 Aug 2008
Posts: 539
Location: Bavaria

PostPosted: Thu Jul 30, 2009 12:07 pm    Post subject: Re: Dismal performance with large project Reply with quote

Thomas Wolf wrote:
6.7.1 has quite a few performance-related fixes
Not really.

I hoped that 6.7.1 would be usable again, but e.g. when switching project groups to a large project (Liferay source) scanning never stops (at least not within 20minutes) and uses one processor for 100%

And that is with no changes whatsoever to that project.

Each time I switch my project group I have to kill NetBeans and restart it, otherwise it's not usable.
Back to top
Thomas Wolf
Posted via mailing list.





PostPosted: Thu Jul 30, 2009 1:13 pm    Post subject: Dismal performance with large project Reply with quote

Overall, I'm much happier with 6.7.1. than with 6.7 performance-wise.
But 6.7 set a pretty low bar.

Yesterday (after I posted about 6.7.1 having a lot of peformance-related
fixes Sad, I had the dubious pleasure of merging some massive changes
from a branch into the trunk. There were lots of merge conflicts I had
to deal with. That wasn't a problem. The problem was that NB seemed
incapable of finding most classes with ctrl-o! Seems like every other
class I tried, NB would not show it. Totally useless. Once I restarted
NB - still with many unresolved conflicts - it would magically find
those same classes. The Navigator also occasionally seemed to "fall
behind" - it would just sit there blank for a minute or more after
switching to a given source file and, eventually, display the
methods/fields.

Our project is reasonably large (~3800 java files, 100+ 3rd-party jars)
- it's a single SE project. In 6.7.1 I haven't had the problem you
described where there's scanning at startup even when there was no
changes since last startup. In 6.7 there was, so I saw an improvement.
You're using multiple projects, so perhaps that's the difference.

6.7.1. was, I think, explicitly to address many of the performance
shortcomings. I hope that more work is being done for 6.8 because
6.7.1. is far from ideal. Yesterday, when I couldn't find classes I was
ready to give up on the IDE - I mean, what the hell good is an IDE when
it can't even find the classes you want to work with? Never mind bad
performance - that's zero performance Sad
[not even sure writing an issue on this will do any good because I don't
even know how to reproduce it.]

Tom



On 07/30/2009 08:07 AM, tkellerer wrote:
Quote:
Thomas Wolf wrote:

Quote:
6.7.1 has quite a few performance-related fixes

Not really.



I hoped that 6.7.1 would be usable again, but e.g. when switching project groups to a large project (Liferay source) scanning never stops (at least not within 20minutes) and uses one processor for 100%



And that is with no changes whatsoever to that project.



Each time I switch my project group I have to kill NetBeans and restart it, otherwise it's not usable.



**********************************************************************************************
IMPORTANT: The contents of this email and any attachments are confidential. They are intended for the
named recipient(s) only.
If you have received this email in error, please notify the system manager or the sender immediately and do
not disclose the contents to anyone or make copies thereof.
*** eSafe scanned this email for viruses, vandals, and malicious content. ***
**********************************************************************************************
Back to top
iboyd



Joined: 29 Jul 2009
Posts: 5

PostPosted: Thu Jul 30, 2009 4:02 pm    Post subject: Reply with quote

Quote:
The Navigator also occasionally seemed to "fall
behind" - it would just sit there blank for a minute or more after
switching to a given source file and, eventually, display the
methods/fields.


I've experienced this as well. Also code folds can take several minutes to appear. Find file (alt+shift+o) is so slow as to be useless. Heap usage just grows and grows and grows. I "upgraded" to 6.5 yesterday, performance is much improved.
Back to top
Gregg Wonderly
Posted via mailing list.





PostPosted: Thu Jul 30, 2009 4:14 pm    Post subject: Dismal performance with large project Reply with quote

iboyd wrote:
Quote:
I have a large project (30k+ files, haven't counted the classes yet). The performance is dismal.

I notice that you are using free form projects. The IDE really doesn't keep
much meta-data synchronized automatically for free form projects, it seems in my
experience. I've been slowly abandoning my free-form projects and just creating
'java project with existing source' or 'library' projects, and then redirecting
some of the projects ANT targets to the 'important' targets in my existing ant
targets.

When I do this, I find that the IDE seems to be remembering a bit more about
what I am doing and it is not getting into so many internal arguments with
itself about what it already knows.

It's a slow and painful process, but the pain from what I've learned so far,
seems to be a more and more distant memory.

Gregg Wonderly
Back to top
iboyd



Joined: 29 Jul 2009
Posts: 5

PostPosted: Thu Jul 30, 2009 4:53 pm    Post subject: Reply with quote

Thanks for the suggestion Gregg. I'll give that a shot (again). Tried briefly yesterday, ran into a bit of an issue, and in my frustration gave up on it.

That may work out well as many of my ant targets don't run successfully from the IDE anyhow and have reverted to command line for that (~400 seperate ant targets, some work, some don't, haven't tried them all).
Back to top
Thomas Wolf
Posted via mailing list.





PostPosted: Thu Jul 30, 2009 9:21 pm    Post subject: Dismal performance with large project Reply with quote

On 07/30/2009 12:02 PM, iboyd wrote:
Quote:
Quote:
I've experienced this as well. Also code folds can take several minutes to appear. Heap usage just grows and grows and grows. I "upgraded" to 6.5 yesterday, performance is much improved.


Does anyone still have a copy of 3.x around? I'm kind of curious
whether it's still usable. I'm guessing not as it won't support JDK 5+
language features...NB 3.x didn't use ant for building. As I get older,
I harken back to the simple days :-)

Darn it, we just added generics to our source - I guess that takes care
of that experiment :-}

tom


**********************************************************************************************
IMPORTANT: The contents of this email and any attachments are confidential. They are intended for the
named recipient(s) only.
If you have received this email in error, please notify the system manager or the sender immediately and do
not disclose the contents to anyone or make copies thereof.
*** eSafe scanned this email for viruses, vandals, and malicious content. ***
**********************************************************************************************
Back to top
Peter B. West
Posted via mailing list.





PostPosted: Thu Jul 30, 2009 11:14 pm    Post subject: Dismal performance with large project Reply with quote

This may be a problem specific to project groups. I don't use groups,
but I have no such problem in switching between the LifeRay 5.2.3
source and, say the Apache xmlgraphics projects like Batik and Fop.

OS X 5.7 NB 6.7 updated to 6.7.1.

Peter

On 30/07/2009, at 10:07 PM, tkellerer wrote:

Quote:

Thomas Wolf wrote:
Quote:
6.7.1 has quite a few performance-related fixes
Not really.



I hoped that 6.7.1 would be usable again, but e.g. when switching
project groups to a large project (Liferay source) scanning never
stops (at least not within 20minutes) and uses one processor for 100%



And that is with no changes whatsoever to that project.



Each time I switch my project group I have to kill NetBeans and
restart it, otherwise it's not usable.



Back to top
Display posts from previous:   
Post new topic   Reply to topic    NetBeans Forums -> NetBeans Users All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB
By use of this website, you agree to the NetBeans Policies and Terms of Use. © 2012, Oracle Corporation and/or its affiliates. Sponsored by Oracle logo