Apr 20 17:25:11 devstack cinder-volume[73019]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 20 17:25:11 devstack cinder-volume[73019]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 17:25:11 devstack cinder-volume[73019]: we strongly recommend against using it for new projects.
Apr 20 17:25:11 devstack cinder-volume[73019]: If you are already using Eventlet, we recommend migrating to a different
Apr 20 17:25:11 devstack cinder-volume[73019]: framework.  For more detail see
Apr 20 17:25:11 devstack cinder-volume[73019]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 17:25:11 devstack cinder-volume[73019]:   import eventlet  # noqa
Apr 20 17:25:12 devstack cinder-volume[73019]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73019) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 17:25:12 devstack cinder-volume[73019]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73019) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 17:25:12 devstack cinder-volume[73019]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73019) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 17:25:13 devstack cinder-volume[73019]: INFO dbcounter [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Registered counter for database cinder
Apr 20 17:25:13 devstack cinder-volume[73019]: DEBUG oslo_db.sqlalchemy.engines [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:25:13 devstack cinder-volume[73019]: DEBUG dbcounter [-] [73019] Writer thread running {{(pid=73019) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 17:25:13 devstack cinder-volume[73019]: INFO cinder.rpc [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 20 17:25:13 devstack cinder-volume[73019]: INFO cinder.rpc [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 20 17:25:13 devstack cinder-volume[73019]: DEBUG oslo_db.sqlalchemy.engines [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:25:13 devstack cinder-volume[73019]: INFO cinder.volume.manager [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Determined volume DB was empty at startup.
Apr 20 17:25:13 devstack cinder-volume[73019]: DEBUG cinder.volume.manager [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73019) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 20 17:25:13 devstack cinder-volume[73019]: INFO cinder.volume.manager [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 20 17:25:13 devstack cinder-volume[73019]: WARNING stevedore.named [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 17:25:13 devstack cinder-volume[73019]: WARNING castellan.key_manager [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 17:25:13 devstack cinder-volume[73019]: WARNING cinder.keymgr.conf_key_mgr [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 17:25:13 devstack cinder-volume[73019]: DEBUG cinder.volume.drivers.lvm [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73019) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 20 17:25:13 devstack cinder-volume[73019]: DEBUG oslo_concurrency.processutils [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73019) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_concurrency.processutils [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] CMD "cinder-rtstool verify" returned: 0 in 0.244s {{(pid=73019) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_db.sqlalchemy.engines [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:25:14 devstack cinder-volume[73019]: INFO cinder.rpc [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 20 17:25:14 devstack cinder-volume[73019]: INFO cinder.rpc [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 20 17:25:14 devstack cinder-volume[73019]: WARNING stevedore.named [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 17:25:14 devstack cinder-volume[73019]: WARNING castellan.key_manager [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 17:25:14 devstack cinder-volume[73019]: INFO cinder.volume.manager [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_db.sqlalchemy.engines [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73019) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:25:14 devstack cinder-volume[73019]: INFO oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Starting 1 workers
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Started child 73126 {{(pid=73019) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Full set of CONF: {{(pid=73019) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] ******************************************************************************** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Configuration options gathered from: {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] ================================================================================ {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] allow_availability_zone_fallback = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] allow_compression_on_image_upload = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] allowed_direct_url_schemes     = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] api_rate_limit                 = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] auth_strategy                  = keystone {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] az_cache_duration              = 3600 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_availability_zone      = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_host                   = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_name                   = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_stats_polling_interval = 60 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backup_api_class               = cinder.backup.api.API {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backup_name_template           = backup-%s {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backup_use_same_host           = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backup_use_temp_snapshot       = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] chap_password                  = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] chap_username                  =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73126]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cinder_internal_tenant_project_id = eb11abf845fa4200b0d45043c54116a7 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cinder_internal_tenant_user_id = 06e06a3f393e4da48fd3ddc088ad859a {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cloned_volume_same_az          = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cluster                        = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] compression_format             = gzip {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] compute_api_class              = cinder.compute.nova.API {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] config_dir                     = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] config_source                  = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] control_exchange               = openstack {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] debug                          = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] default_availability_zone      = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] default_group_type             = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] default_volume_type            = lvmdriver-1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] disk_geometry                  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] driver_client_cert             = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] driver_client_cert_key         = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] driver_data_namespace          = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] driver_ssl_cert_path           = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] driver_ssl_cert_verify         = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] driver_use_ssl                 = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] enable_force_upload            = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] enable_new_services            = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] enable_unsupported_driver      = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] enforce_multipath_for_image_xfer = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] filter_function                = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_api_insecure            = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_api_servers             = ['http://192.168.122.198/image'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_api_ssl_compression     = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_ca_certificates_file    = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_catalog_info            = image:glance:publicURL {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_certfile                = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_keyfile                 = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_num_retries             = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance_request_timeout         = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] goodness_function              = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] graceful_shutdown_timeout      = 5 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] group_api_class                = cinder.group.api.API {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] host                           = devstack {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_compress_on_upload       = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_conversion_address_space_limit = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_conversion_cpu_limit     = 60 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_conversion_disable       = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_upload_use_cinder_backend = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_upload_use_internal_tenant = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_volume_cache_enabled     = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_volume_cache_max_count   = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] image_volume_cache_max_size_gb = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] init_host_max_objects_retrieval = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] iscsi_target_flags             =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] iscsi_write_cache              = on {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] iser_helper                    = tgtadm {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] iser_ip_address                = 192.168.122.198 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] iser_port                      = 3260 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] log_color                      = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] log_config_append              = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] log_dir                        = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] log_file                       = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] log_options                    = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] log_rotate_interval            = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] log_rotate_interval_type       = days {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] log_rotation_type              = none {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] max_age                        = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] max_logfile_count              = 30 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] max_logfile_size_mb            = 200 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] max_over_subscription_ratio    = 20.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] message_reap_interval          = 86400 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] message_ttl                    = 2592000 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] migration_create_volume_timeout_secs = 300 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] monkey_patch                   = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] monkey_patch_modules           = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] my_ip                          = 192.168.122.198 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] no_snapshot_gb_quota           = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] num_iser_scan_tries            = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] num_shell_tries                = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] num_volume_device_scan_tries   = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] nvmeof_conn_info_version       = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] nvmet_ns_id                    = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] nvmet_port_id                  = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] osapi_max_limit                = 1000 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] osapi_volume_ext_list          = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] osapi_volume_listen_port       = 8776 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] osapi_volume_use_ssl           = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] osapi_volume_workers           = 2 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] per_volume_size_limit          = -1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] periodic_fuzzy_delay           = 60 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] periodic_interval              = 60 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] public_endpoint                = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] publish_errors                 = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] quota_backup_gigabytes         = 1000 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] quota_backups                  = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] quota_gigabytes                = 1000 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] quota_groups                   = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] quota_snapshots                = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] quota_volumes                  = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] rate_limit_burst               = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] rate_limit_except_level        = CRITICAL {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] rate_limit_interval            = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] reinit_driver_count            = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] replication_device             = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] report_discard_supported       = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] report_interval                = 120 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] reservation_clean_interval     = 86400 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] reservation_expire             = 86400 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] reserved_image_namespaces      = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] reserved_percentage            = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] rpc_response_timeout           = 120 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] run_external_periodic_tasks    = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] scst_target_driver             = iscsi {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] scst_target_iqn_name           = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_down_time              = 720 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] shell_completion               = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] snapshot_name_template         = snapshot-%s {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] snapshot_same_host             = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] split_loggers                  = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] state_path                     = /opt/stack/data/cinder {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] storage_availability_zone      = nova {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] storage_protocol               = iSCSI {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] syslog_log_facility            = LOG_USER {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] target_helper                  = lioadm {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] target_ip_address              = 192.168.122.198 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] target_port                    = 3260 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] target_protocol                = iscsi {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] target_secondary_ip_addresses  = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] trace_flags                    = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] transport_url                  = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] until_refresh                  = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] use_chap_auth                  = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] use_default_quota_class        = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] use_journal                    = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] use_json                       = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] use_multipath_for_image_xfer   = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] use_stderr                     = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] use_syslog                     = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] verify_glance_signatures       = enabled {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_api_class               = cinder.volume.api.API {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_backend_name            = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_clear                   = zero {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_clear_ionice            = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_clear_size              = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_copy_bps_limit          = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_dd_blocksize            = 1M {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_name_template           = volume-%s {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_service_inithost_offload = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volume_usage_audit_period      = month {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] zoning_mode                    = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_concurrency.disable_process_locking = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.admin_password = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.admin_token = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.admin_user  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.auth_port   = 35357 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.auth_protocol = https {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.auth_section = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.auth_type   = password {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.auth_uri    = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.auth_version = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.cache       = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.certfile    = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.identity_uri = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.include_service_catalog = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.insecure    = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.interface   = public {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.keyfile     = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_password =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcache_username =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.region_name = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.service_type = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.198/identity {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.backend                  = dogpile.cache.null {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.backend_argument         = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.backend_expiration_time  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.config_prefix            = cache.oslo {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.debug_cache_backend      = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.enable_retry_client      = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.enable_socket_keepalive  = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.enabled                  = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.enforce_fips_mode        = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.expiration_time          = 600 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.hashclient_retry_attempts = 2 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.memcache_dead_retry      = 300 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.memcache_sasl_enabled    = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.password                 = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.proxies                  = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.redis_db                 = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.redis_server             = localhost:6379 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.retry_attempts           = 2 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.retry_delay              = 0.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.socket_keepalive_count   = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.socket_keepalive_idle    = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.socket_keepalive_interval = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.socket_timeout           = 1.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.tls_allowed_ciphers      = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.tls_cafile               = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.tls_certfile             = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.tls_enabled              = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.tls_keyfile              = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cache.username                 = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] coordination.backend_url       = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73126]: INFO cinder.volume.manager [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.asyncio_connection    = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.asyncio_slave_connection = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.backend               = sqlalchemy {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.connection            = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.connection_debug      = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.connection_parameters =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.connection_recycle_time = 3600 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.connection_trace      = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.db_inc_retry_interval = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.db_max_retries        = 20 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.db_max_retry_interval = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.db_retry_interval     = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.max_overflow          = 50 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.max_pool_size         = 5 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.max_retries           = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.mysql_wsrep_sync_wait = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.pool_timeout          = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.retry_interval        = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.slave_connection      = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.sqlite_synchronous    = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.synchronous_reader    = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] database.use_db_reconnect      = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.connection_string     = messaging:// {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.enabled               = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.es_doc_type           = notification {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.es_scroll_size        = 10000 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.es_scroll_time        = 2m {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.filter_error_trace    = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.hmac_keys             = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.sentinel_service_name = mymaster {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.socket_timeout        = 0.1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.trace_requests        = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler.trace_sqlalchemy      = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler_jaeger.process_tags   = {} {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler_jaeger.service_name_prefix = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] profiler_otlp.service_name_prefix = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.enforce_new_defaults = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: WARNING oslo_config.cfg [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.enforce_scope      = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.policy_default_rule = default {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] privsep_osbrick.group          = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] privsep_osbrick.helper_command = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] privsep_osbrick.user           = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cinder_sys_admin.group         = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cinder_sys_admin.helper_command = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] cinder_sys_admin.user          = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.auth_section      = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.auth_type         = password {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.cafile            = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.certfile          = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.collect_timing    = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.insecure          = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.keyfile           = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.send_service_user_token = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.split_loggers     = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] service_user.timeout           = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.auth_section            = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.auth_type               = password {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.certfile                = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.collect_timing          = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.insecure                = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.keyfile                 = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.region_name             = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.split_loggers           = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] glance.timeout                 = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.backend_availability_zone = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.chap_password = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.chap_username =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.disk_geometry = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.driver_client_cert = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.driver_client_cert_key = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.driver_data_namespace = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.driver_use_ssl = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.extra_capabilities = {} {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.filter_function = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.goodness_function = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.iscsi_target_flags =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.iscsi_write_cache = on {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.iser_helper   = tgtadm {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.iser_ip_address = 192.168.122.198 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.iser_port     = 3260 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.lvm_share_target = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.lvm_type      = auto {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.num_shell_tries = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.replication_device = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.report_discard_supported = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.reserved_percentage = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.target_helper = tgtadm {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.target_ip_address = 192.168.122.198 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.target_port   = 3260 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.target_protocol = iscsi {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.trace_flags   = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.unique_fqdn_network = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.use_chap_auth = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volume_backend_name = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volume_clear  = zero {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volume_clear_ionice = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volume_clear_size = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_reports.file_event_handler = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_reports.log_dir           = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.backend_host       = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.chap_password      = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.chap_username      = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.disk_geometry      = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.driver_client_cert = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.extra_capabilities = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.filter_function    = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.goodness_function  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.061s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.iser_helper        = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.iser_ip_address    = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.iser_port          = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.lvm_share_target   = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.lvm_type           = auto {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.num_shell_tries    = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.replication_device = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.report_discard_supported = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.reserved_percentage = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.scst_target_driver = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.storage_protocol   = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.target_helper      = lioadm {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.target_ip_address  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.target_port        = 3260 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.trace_flags        = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.use_chap_auth      = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volume_clear       = zero {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volume_clear_size  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] lvmdriver-1.volumes_dir        = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_notifications.driver = [] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_notifications.retry = -1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] key_manager.fixed_key          = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.barbican_api_version  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.barbican_endpoint     = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.barbican_endpoint_type = public {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.barbican_region_name  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.cafile                = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.certfile              = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.collect_timing        = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.insecure              = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.keyfile               = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.number_of_retries     = 60 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.retry_delay           = 1 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.send_service_user_token = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.split_loggers         = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.timeout               = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.verify_ssl            = True {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican.verify_ssl_path       = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican_service_user.auth_section = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican_service_user.auth_type = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican_service_user.cafile   = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican_service_user.certfile = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican_service_user.collect_timing = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican_service_user.insecure = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican_service_user.keyfile  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican_service_user.split_loggers = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] barbican_service_user.timeout  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.approle_role_id          = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.approle_secret_id        = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.kv_mountpoint            = secret {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.kv_path                  = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.kv_version               = 2 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.namespace                = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.root_token_id            = **** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.ssl_ca_crt_file          = None {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.timeout                  = 60.0 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.use_ssl                  = False {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:25:14 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] ******************************************************************************** {{(pid=73019) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 20 17:25:14 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:14 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:14 devstack sudo[73130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 20 17:25:14 devstack sudo[73130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:14 devstack sudo[73130]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:14 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.566s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:14 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:14 devstack sudo[73220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:25:14 devstack sudo[73220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:15 devstack sudo[73220]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:15 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.511s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:15 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:25:15 devstack cinder-volume[73126]: INFO cinder.brick.local_dev.lvm [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 20 17:25:15 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:15 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:15 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:15 devstack sudo[73448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 17:25:15 devstack sudo[73448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:15 devstack sudo[73448]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:15 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:15 devstack cinder-volume[73126]: DEBUG cinder.brick.local_dev.lvm [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73126) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 20 17:25:15 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:15 devstack sudo[73621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:25:15 devstack sudo[73621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:16 devstack sudo[73621]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:16 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.960s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:16 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:16 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:16 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:16 devstack sudo[73786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:25:16 devstack sudo[73786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:17 devstack sudo[73786]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:17 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:17 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:17 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:17 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:17 devstack sudo[73826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 20 17:25:17 devstack sudo[73826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:17 devstack sudo[73826]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:17 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.441s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:17 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:17 devstack sudo[73829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 17:25:17 devstack sudo[73829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:18 devstack sudo[73829]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:18 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:18 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:18 devstack sudo[73834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 17:25:18 devstack sudo[73834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:18 devstack sudo[73834]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:18 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:18 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:18 devstack sudo[73840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:25:18 devstack sudo[73840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:19 devstack sudo[73840]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:19 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:19 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:19 devstack sudo[73845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:25:19 devstack sudo[73845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:19 devstack sudo[73845]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:19 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:19 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:19 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:19 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:19 devstack sudo[73849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:25:19 devstack sudo[73849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:20 devstack sudo[73849]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:20 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:20 devstack cinder-volume[73126]: INFO cinder.volume.drivers.lvm [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 20 17:25:20 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:20 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:20 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:20 devstack sudo[73857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:25:20 devstack sudo[73857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:20 devstack sudo[73857]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:20 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:20 devstack cinder-volume[73126]: DEBUG cinder.volume.drivers.lvm [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Updating volume stats {{(pid=73126) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 17:25:20 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:20 devstack sudo[73966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 17:25:20 devstack sudo[73966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:21 devstack sudo[73966]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:21 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:21 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:21 devstack sudo[73977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:25:21 devstack sudo[73977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:21 devstack sudo[73977]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:21 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:21 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:21 devstack sudo[74116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:25:21 devstack sudo[74116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:21 devstack sudo[74116]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:21 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:21 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:21 devstack sudo[74120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:25:21 devstack sudo[74120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:22 devstack sudo[74120]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:22 devstack cinder-volume[73126]: INFO cinder.volume.driver [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Driver hasn't implemented _init_vendor_properties()
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG cinder.volume.driver [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73126) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG oslo_db.sqlalchemy.engines [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG dbcounter [-] [73126] Writer thread running {{(pid=73126) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG cinder.db.sqlalchemy.api [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Building query based on filter {{(pid=73126) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG cinder.image.image_utils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73126) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 20 17:25:22 devstack cinder-volume[73126]: INFO cinder.keymgr.migration [None req-4052e287-bad4-4ec1-8efb-aeb2d7637ecc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG cinder.volume.drivers.lvm [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Updating volume stats {{(pid=73126) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:22 devstack sudo[74125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 17:25:22 devstack sudo[74125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:22 devstack sudo[74125]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:22 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:22 devstack sudo[74131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:25:22 devstack sudo[74131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:23 devstack sudo[74131]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:23 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:23 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:23 devstack sudo[74135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:25:23 devstack sudo[74135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:23 devstack sudo[74135]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:23 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:23 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:23 devstack sudo[74140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:25:23 devstack sudo[74140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:24 devstack cinder-volume[73019]: DEBUG dbcounter [-] [73019] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73019) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:25:24 devstack sudo[74140]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:24 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:24 devstack cinder-volume[73126]: DEBUG cinder.manager [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Notifying Schedulers of capabilities ... {{(pid=73126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:25:24 devstack cinder-volume[73126]: INFO cinder.volume.manager [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Driver initialization completed successfully.
Apr 20 17:25:24 devstack cinder-volume[73126]: INFO cinder.manager [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Initiating service 2 cleanup
Apr 20 17:25:24 devstack cinder-volume[73126]: INFO cinder.manager [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Service 2 cleanup completed.
Apr 20 17:25:24 devstack cinder-volume[73126]: DEBUG cinder.service [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Creating RPC server for service cinder-volume {{(pid=73126) start /opt/stack/cinder/cinder/service.py:231}}
Apr 20 17:25:24 devstack cinder-volume[73126]: DEBUG cinder.service [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73126) start /opt/stack/cinder/cinder/service.py:237}}
Apr 20 17:25:24 devstack cinder-volume[73126]: INFO cinder.volume.manager [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 20 17:25:24 devstack cinder-volume[73126]: DEBUG cinder.volume.drivers.lvm [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Updating volume stats {{(pid=73126) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 17:25:24 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:24 devstack sudo[74145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 17:25:24 devstack sudo[74145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:24 devstack sudo[74145]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:24 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:24 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:24 devstack sudo[74152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:25:24 devstack sudo[74152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:25 devstack sudo[74152]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:25 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:25 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:25 devstack sudo[74155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:25:25 devstack sudo[74155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:25 devstack sudo[74155]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:25 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:25 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:25:25 devstack sudo[74213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:25:25 devstack sudo[74213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:25:26 devstack sudo[74213]: pam_unix(sudo:session): session closed for user root
Apr 20 17:25:26 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:25:26 devstack cinder-volume[73126]: INFO cinder.volume.manager [None req-c51f0900-04fd-470e-9a77-d13d5ea516d5 None None] Driver post RPC initialization completed successfully.
Apr 20 17:25:36 devstack cinder-volume[73126]: DEBUG dbcounter [-] [73126] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73126) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:25:36 devstack cinder-volume[73126]: DEBUG dbcounter [-] [73126] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=73126) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:26:52 devstack cinder-volume[73126]: DEBUG oslo_service.periodic_task [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73126) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:26:52 devstack cinder-volume[73126]: DEBUG cinder.volume.drivers.lvm [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Updating volume stats {{(pid=73126) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 17:26:52 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:26:52 devstack sudo[79148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 17:26:52 devstack sudo[79148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:26:52 devstack sudo[79148]: pam_unix(sudo:session): session closed for user root
Apr 20 17:26:52 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:26:52 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:26:52 devstack sudo[79191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:26:52 devstack sudo[79191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:26:53 devstack sudo[79191]: pam_unix(sudo:session): session closed for user root
Apr 20 17:26:53 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:26:53 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:26:53 devstack sudo[79199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:26:53 devstack sudo[79199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:26:53 devstack sudo[79199]: pam_unix(sudo:session): session closed for user root
Apr 20 17:26:53 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.430s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:26:53 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:26:53 devstack sudo[79203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:26:53 devstack sudo[79203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:26:54 devstack sudo[79203]: pam_unix(sudo:session): session closed for user root
Apr 20 17:26:54 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:26:54 devstack cinder-volume[73126]: DEBUG cinder.manager [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Notifying Schedulers of capabilities ... {{(pid=73126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:27:36 devstack cinder-volume[73126]: DEBUG dbcounter [-] [73126] Writing DB stats cinder:SELECT=1 {{(pid=73126) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:27:36 devstack cinder-volume[73126]: DEBUG dbcounter [-] [73126] Writing DB stats cinder:UPDATE=1 {{(pid=73126) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:27:52 devstack cinder-volume[73126]: DEBUG oslo_service.periodic_task [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73126) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:27:52 devstack cinder-volume[73126]: DEBUG cinder.volume.drivers.lvm [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Updating volume stats {{(pid=73126) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 20 17:27:52 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:27:52 devstack sudo[81036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 20 17:27:52 devstack sudo[81036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:27:52 devstack sudo[81036]: pam_unix(sudo:session): session closed for user root
Apr 20 17:27:52 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:27:52 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:27:52 devstack sudo[81050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:27:52 devstack sudo[81050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:27:53 devstack sudo[81050]: pam_unix(sudo:session): session closed for user root
Apr 20 17:27:53 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:27:53 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:27:53 devstack sudo[81067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 20 17:27:53 devstack sudo[81067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:27:53 devstack sudo[81067]: pam_unix(sudo:session): session closed for user root
Apr 20 17:27:53 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:27:53 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:27:53 devstack sudo[81083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 20 17:27:53 devstack sudo[81083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:27:54 devstack sudo[81083]: pam_unix(sudo:session): session closed for user root
Apr 20 17:27:54 devstack cinder-volume[73126]: DEBUG oslo_concurrency.processutils [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73126) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:27:54 devstack cinder-volume[73126]: DEBUG cinder.manager [None req-2fff1f94-9d36-4b90-84ca-7369bff2992c None None] Notifying Schedulers of capabilities ... {{(pid=73126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:28:43 devstack cinder-volume[73019]: INFO oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Caught SIGTERM, stopping children
Apr 20 17:28:43 devstack cinder-volume[73019]: DEBUG oslo_concurrency.lockutils [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Acquiring lock "singleton_lock" {{(pid=73019) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 17:28:43 devstack cinder-volume[73019]: DEBUG oslo_concurrency.lockutils [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Acquired lock "singleton_lock" {{(pid=73019) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 17:28:43 devstack cinder-volume[73019]: DEBUG oslo_concurrency.lockutils [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Releasing lock "singleton_lock" {{(pid=73019) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 17:28:43 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Stop services. {{(pid=73019) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 20 17:28:43 devstack cinder-volume[73019]: DEBUG oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Killing children. {{(pid=73019) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 20 17:28:43 devstack cinder-volume[73019]: INFO oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Waiting on 1 children to exit
Apr 20 17:28:44 devstack cinder-volume[73126]: DEBUG oslo_concurrency.lockutils [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Acquiring lock "singleton_lock" {{(pid=73126) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 17:28:44 devstack cinder-volume[73126]: DEBUG oslo_concurrency.lockutils [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Acquired lock "singleton_lock" {{(pid=73126) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 17:28:44 devstack cinder-volume[73126]: DEBUG oslo_concurrency.lockutils [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Releasing lock "singleton_lock" {{(pid=73126) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 17:28:44 devstack cinder-volume[73126]: WARNING amqp [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 17:28:44 devstack cinder-volume[73126]: WARNING amqp [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 17:28:44 devstack cinder-volume[73019]: INFO oslo_service.backend._eventlet.service [None req-bb772ece-efca-4a73-872a-c0ef99d7ff47 None None] Child 73126 exited with status 0
Apr 20 17:28:44 devstack cinder-volume[82173]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 20 17:28:44 devstack cinder-volume[82173]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 17:28:44 devstack cinder-volume[82173]: we strongly recommend against using it for new projects.
Apr 20 17:28:44 devstack cinder-volume[82173]: If you are already using Eventlet, we recommend migrating to a different
Apr 20 17:28:44 devstack cinder-volume[82173]: framework.  For more detail see
Apr 20 17:28:44 devstack cinder-volume[82173]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 17:28:44 devstack cinder-volume[82173]:   import eventlet  # noqa
Apr 20 17:28:46 devstack cinder-volume[82173]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82173) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 17:28:46 devstack cinder-volume[82173]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82173) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 17:28:46 devstack cinder-volume[82173]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82173) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 17:28:47 devstack cinder-volume[82173]: INFO dbcounter [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Registered counter for database cinder
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_db.sqlalchemy.engines [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82173) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG dbcounter [-] [82173] Writer thread running {{(pid=82173) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 17:28:47 devstack cinder-volume[82173]: INFO cinder.rpc [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 20 17:28:47 devstack cinder-volume[82173]: INFO cinder.rpc [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_db.sqlalchemy.engines [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82173) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:28:47 devstack cinder-volume[82173]: INFO cinder.volume.manager [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Determined volume DB was empty at startup.
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG cinder.volume.manager [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82173) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 20 17:28:47 devstack cinder-volume[82173]: INFO cinder.volume.manager [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 20 17:28:47 devstack cinder-volume[82173]: WARNING stevedore.named [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 17:28:47 devstack cinder-volume[82173]: WARNING castellan.key_manager [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 17:28:47 devstack cinder-volume[82173]: WARNING cinder.keymgr.conf_key_mgr [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 17:28:47 devstack cinder-volume[82173]: INFO cinder.volume.manager [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_db.sqlalchemy.engines [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82173) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:28:47 devstack cinder-volume[82173]: INFO oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Starting 1 workers
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Started child 82289 {{(pid=82173) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Full set of CONF: {{(pid=82173) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] ******************************************************************************** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Configuration options gathered from: {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] ================================================================================ {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] allow_availability_zone_fallback = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] allow_compression_on_image_upload = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] allowed_direct_url_schemes     = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] api_rate_limit                 = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] auth_strategy                  = keystone {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_availability_zone      = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_host                   = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_name                   = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_stats_polling_interval = 60 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backup_api_class               = cinder.backup.api.API {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backup_name_template           = backup-%s {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backup_use_same_host           = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backup_use_temp_snapshot       = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] chap_password                  = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] chap_username                  =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cinder_internal_tenant_project_id = eb11abf845fa4200b0d45043c54116a7 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cinder_internal_tenant_user_id = 06e06a3f393e4da48fd3ddc088ad859a {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cluster                        = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] compression_format             = gzip {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] config_dir                     = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] config_source                  = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] control_exchange               = openstack {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] debug                          = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82289]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] default_availability_zone      = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] default_group_type             = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] default_volume_type            = QuobyteHD {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] disk_geometry                  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] driver_client_cert             = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] driver_client_cert_key         = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] driver_data_namespace          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] driver_ssl_cert_path           = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] driver_ssl_cert_verify         = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] driver_use_ssl                 = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] enable_new_services            = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] enable_unsupported_driver      = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] enforce_multipath_for_image_xfer = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] filter_function                = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_api_insecure            = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_api_servers             = ['http://192.168.122.198/image'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_api_ssl_compression     = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_ca_certificates_file    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_certfile                = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_keyfile                 = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_num_retries             = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance_request_timeout         = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] goodness_function              = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] graceful_shutdown_timeout      = 5 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] group_api_class                = cinder.group.api.API {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] host                           = devstack {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_compress_on_upload       = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_conversion_address_space_limit = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_conversion_cpu_limit     = 60 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_conversion_disable       = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_upload_use_cinder_backend = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_upload_use_internal_tenant = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_volume_cache_enabled     = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_volume_cache_max_count   = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] image_volume_cache_max_size_gb = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] init_host_max_objects_retrieval = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] iscsi_target_flags             =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] iscsi_write_cache              = on {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] iser_helper                    = tgtadm {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] iser_ip_address                = 192.168.122.198 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] iser_port                      = 3260 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] log_color                      = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] log_config_append              = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] log_dir                        = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] log_file                       = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] log_options                    = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] log_rotate_interval            = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] log_rotate_interval_type       = days {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] log_rotation_type              = none {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] max_age                        = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] max_logfile_count              = 30 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] max_logfile_size_mb            = 200 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] max_over_subscription_ratio    = 20.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] message_reap_interval          = 86400 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] message_ttl                    = 2592000 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] migration_create_volume_timeout_secs = 300 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] monkey_patch                   = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] monkey_patch_modules           = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] my_ip                          = 192.168.122.198 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] no_snapshot_gb_quota           = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] num_iser_scan_tries            = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] num_shell_tries                = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] num_volume_device_scan_tries   = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] nvmeof_conn_info_version       = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] nvmet_ns_id                    = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] nvmet_port_id                  = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] osapi_max_limit                = 1000 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] osapi_volume_ext_list          = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] osapi_volume_listen_port       = 8776 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] osapi_volume_use_ssl           = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] osapi_volume_workers           = 2 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] per_volume_size_limit          = -1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] periodic_fuzzy_delay           = 60 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] periodic_interval              = 60 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] public_endpoint                = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] publish_errors                 = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] quota_backup_gigabytes         = 1000 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] quota_backups                  = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] quota_gigabytes                = 1000 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] quota_groups                   = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] quota_snapshots                = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] quota_volumes                  = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] rate_limit_burst               = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] rate_limit_except_level        = CRITICAL {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] rate_limit_interval            = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] reinit_driver_count            = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] replication_device             = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] report_discard_supported       = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] report_interval                = 120 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] reservation_clean_interval     = 86400 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] reservation_expire             = 86400 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] reserved_image_namespaces      = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] reserved_percentage            = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] rpc_response_timeout           = 120 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82289]: INFO cinder.volume.manager [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] run_external_periodic_tasks    = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82289]: DEBUG cinder.volume.drivers.remotefs [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82289) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] scst_target_driver             = iscsi {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] scst_target_iqn_name           = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_down_time              = 720 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] shell_completion               = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] snapshot_name_template         = snapshot-%s {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] split_loggers                  = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] state_path                     = /opt/stack/data/cinder {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] storage_availability_zone      = nova {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] storage_protocol               = iSCSI {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] syslog_log_facility            = LOG_USER {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] target_helper                  = lioadm {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] target_ip_address              = 192.168.122.198 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] target_port                    = 3260 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] target_protocol                = iscsi {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] target_secondary_ip_addresses  = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] trace_flags                    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] transport_url                  = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] until_refresh                  = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] use_chap_auth                  = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] use_default_quota_class        = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] use_journal                    = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] use_json                       = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] use_multipath_for_image_xfer   = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] use_stderr                     = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] use_syslog                     = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] verify_glance_signatures       = enabled {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_api_class               = cinder.volume.api.API {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_backend_name            = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_clear                   = zero {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_clear_ionice            = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_clear_size              = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_copy_bps_limit          = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_dd_blocksize            = 1M {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_name_template           = volume-%s {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_service_inithost_offload = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volume_usage_audit_period      = month {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] zoning_mode                    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_concurrency.disable_process_locking = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.admin_password = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.admin_token = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.admin_user  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.auth_protocol = https {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.auth_section = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.auth_type   = password {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.auth_uri    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.auth_version = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.cache       = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.certfile    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.identity_uri = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.include_service_catalog = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.insecure    = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.interface   = public {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.keyfile     = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_password =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcache_username =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.region_name = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.service_type = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.198/identity {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.backend                  = dogpile.cache.null {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.backend_argument         = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.backend_expiration_time  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.config_prefix            = cache.oslo {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.debug_cache_backend      = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.enable_retry_client      = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.enable_socket_keepalive  = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.enabled                  = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.enforce_fips_mode        = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.expiration_time          = 600 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.hashclient_retry_attempts = 2 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.memcache_dead_retry      = 300 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.memcache_sasl_enabled    = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.password                 = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.proxies                  = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.redis_db                 = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.redis_server             = localhost:6379 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.retry_attempts           = 2 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.retry_delay              = 0.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.socket_keepalive_count   = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.socket_keepalive_idle    = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.socket_keepalive_interval = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.socket_timeout           = 1.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.tls_allowed_ciphers      = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.tls_cafile               = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.tls_certfile             = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.tls_enabled              = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.tls_keyfile              = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cache.username                 = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] coordination.backend_url       = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.asyncio_connection    = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.asyncio_slave_connection = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.backend               = sqlalchemy {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.connection            = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.connection_debug      = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.connection_parameters =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.connection_recycle_time = 3600 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.connection_trace      = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.db_inc_retry_interval = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.db_max_retries        = 20 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.db_max_retry_interval = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.db_retry_interval     = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.max_overflow          = 50 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.max_pool_size         = 5 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.max_retries           = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.mysql_wsrep_sync_wait = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.pool_timeout          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.retry_interval        = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.slave_connection      = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.sqlite_synchronous    = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.synchronous_reader    = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] database.use_db_reconnect      = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.connection_string     = messaging:// {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.enabled               = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.es_doc_type           = notification {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.es_scroll_size        = 10000 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.es_scroll_time        = 2m {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.filter_error_trace    = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.hmac_keys             = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.sentinel_service_name = mymaster {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.socket_timeout        = 0.1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.trace_requests        = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler.trace_sqlalchemy      = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler_jaeger.process_tags   = {} {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler_jaeger.service_name_prefix = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] profiler_otlp.service_name_prefix = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.enforce_new_defaults = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: WARNING oslo_config.cfg [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.enforce_scope      = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.policy_default_rule = default {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] privsep_osbrick.group          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] privsep_osbrick.helper_command = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] privsep_osbrick.user           = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cinder_sys_admin.group         = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cinder_sys_admin.helper_command = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] cinder_sys_admin.user          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.auth_section      = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.auth_type         = password {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.cafile            = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.certfile          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.collect_timing    = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.insecure          = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.keyfile           = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.send_service_user_token = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.split_loggers     = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] service_user.timeout           = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.auth_section            = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.auth_type               = password {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.certfile                = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.collect_timing          = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.insecure                = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.keyfile                 = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.region_name             = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.split_loggers           = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] glance.timeout                 = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.backend_availability_zone = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.chap_password = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.chap_username =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.disk_geometry = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.driver_client_cert = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.driver_client_cert_key = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.driver_data_namespace = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.driver_use_ssl = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.extra_capabilities = {} {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.filter_function = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.goodness_function = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.iscsi_target_flags =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.iscsi_write_cache = on {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.iser_ip_address = 192.168.122.198 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.iser_port     = 3260 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_host      =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_login     = admin {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_mount_options = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_password  = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_private_key =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_share_path =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.num_shell_tries = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82289]: DEBUG cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82289) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82289]: WARNING cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82289]: WARNING cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.quobyte_volume_url = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.replication_device = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.report_discard_supported = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.reserved_percentage = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Running cmd (subprocess): mount.quobyte {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.target_helper = tgtadm {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.target_ip_address = 192.168.122.198 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.target_port   = 3260 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.target_protocol = iscsi {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.trace_flags   = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.unique_fqdn_network = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.use_chap_auth = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.volume_backend_name = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.volume_clear  = zero {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.volume_clear_ionice = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.volume_clear_size = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_reports.file_event_handler = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_reports.log_dir           = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.backend_availability_zone = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.backend_host         = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.chap_password        = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.chap_username        = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.disk_geometry        = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.driver_client_cert   = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.driver_data_namespace = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.extra_capabilities   = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.filter_function      = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.goodness_function    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.iser_helper          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.iser_ip_address      = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.iser_port            = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_host             = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_login            = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_mount_options    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_password         = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_private_key      = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_share_path       = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.num_shell_tries      = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.replication_device   = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.report_discard_supported = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.reserved_percentage  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.scst_target_driver   = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.storage_protocol     = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.target_helper        = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.target_ip_address    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.target_port          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.target_prefix        = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.target_protocol      = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.trace_flags          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.use_chap_auth        = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.volume_clear         = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.volume_clear_size    = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] QuobyteHD.volumes_dir          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_notifications.driver = [] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_notifications.retry = -1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] key_manager.fixed_key          = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.barbican_api_version  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.barbican_endpoint     = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.barbican_endpoint_type = public {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.barbican_region_name  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.cafile                = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.certfile              = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.collect_timing        = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.insecure              = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.keyfile               = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.number_of_retries     = 60 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.retry_delay           = 1 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.send_service_user_token = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.split_loggers         = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.timeout               = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.verify_ssl            = True {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican.verify_ssl_path       = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican_service_user.auth_section = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican_service_user.auth_type = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican_service_user.cafile   = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican_service_user.certfile = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican_service_user.collect_timing = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican_service_user.insecure = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican_service_user.keyfile  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican_service_user.split_loggers = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] barbican_service_user.timeout  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.approle_role_id          = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.approle_secret_id        = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.kv_mountpoint            = secret {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.kv_path                  = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.kv_version               = 2 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.namespace                = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.root_token_id            = **** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.ssl_ca_crt_file          = None {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.timeout                  = 60.0 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.use_ssl                  = False {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:47 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] ******************************************************************************** {{(pid=82173) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 20 17:28:47 devstack quobyte-client[82293]: Reading configuration file: /etc/quobyte/client.cfg
Apr 20 17:28:47 devstack quobyte-client[82293]: Invalid parameters found, error: missing mount point.
Apr 20 17:28:47 devstack quobyte-client[82293]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 20 17:28:47 devstack quobyte-client[82293]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 20 17:28:47 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:28:47 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82289) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:28:47 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82289) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:28:47 devstack cinder-volume[82289]: DEBUG cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82289) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:28:47 devstack cinder-volume[82289]: INFO cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a ...
Apr 20 17:28:47 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b -c /etc/quobyte/client-cinder.cfg {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:28:47 devstack sudo[82294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b -c /etc/quobyte/client-cinder.cfg
Apr 20 17:28:47 devstack sudo[82294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:28:48 devstack sudo[82294]: pam_unix(sudo:session): session closed for user root
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.491s {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:28:48 devstack cinder-volume[82289]: INFO cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a succeeded
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82289) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.497s {{(pid=82289) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:28:48 devstack sudo[82363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:28:48 devstack sudo[82363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:28:48 devstack sudo[82363]: pam_unix(sudo:session): session closed for user root
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.378s {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:28:48 devstack cinder-volume[82289]: INFO cinder.volume.driver [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Driver hasn't implemented _init_vendor_properties()
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG cinder.volume.driver [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82289) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG oslo_db.sqlalchemy.engines [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG dbcounter [-] [82289] Writer thread running {{(pid=82289) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG cinder.db.sqlalchemy.api [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Building query based on filter {{(pid=82289) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG cinder.image.image_utils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82289) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 20 17:28:48 devstack cinder-volume[82289]: INFO cinder.keymgr.migration [None req-0e69e610-ae07-4e87-beb3-404d8b078af5 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82289) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82289) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82289) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82289) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82289) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:28:48 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:28:48 devstack sudo[82366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:28:48 devstack sudo[82366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:28:49 devstack sudo[82366]: pam_unix(sudo:session): session closed for user root
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.374s {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG cinder.manager [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Notifying Schedulers of capabilities ... {{(pid=82289) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:28:49 devstack cinder-volume[82289]: INFO cinder.volume.manager [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Driver initialization completed successfully.
Apr 20 17:28:49 devstack cinder-volume[82289]: INFO cinder.manager [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Initiating service 3 cleanup
Apr 20 17:28:49 devstack cinder-volume[82289]: INFO cinder.manager [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Service 3 cleanup completed.
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG cinder.service [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Creating RPC server for service cinder-volume {{(pid=82289) start /opt/stack/cinder/cinder/service.py:231}}
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG cinder.service [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82289) start /opt/stack/cinder/cinder/service.py:237}}
Apr 20 17:28:49 devstack cinder-volume[82289]: INFO cinder.volume.manager [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82289) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82289) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82289) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG cinder.volume.drivers.quobyte [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82289) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82289) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:28:49 devstack sudo[82370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:28:49 devstack sudo[82370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:28:49 devstack sudo[82370]: pam_unix(sudo:session): session closed for user root
Apr 20 17:28:49 devstack cinder-volume[82289]: DEBUG oslo_concurrency.processutils [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.399s {{(pid=82289) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:28:49 devstack cinder-volume[82289]: INFO cinder.volume.manager [None req-445d8a72-b5de-497b-8ba9-20d8c98ed138 None None] Driver post RPC initialization completed successfully.
Apr 20 17:28:51 devstack cinder-volume[82173]: INFO oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Caught SIGTERM, stopping children
Apr 20 17:28:51 devstack cinder-volume[82173]: DEBUG oslo_concurrency.lockutils [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Acquiring lock "singleton_lock" {{(pid=82173) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 17:28:51 devstack cinder-volume[82173]: DEBUG oslo_concurrency.lockutils [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Acquired lock "singleton_lock" {{(pid=82173) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 17:28:51 devstack cinder-volume[82173]: DEBUG oslo_concurrency.lockutils [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Releasing lock "singleton_lock" {{(pid=82173) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 17:28:51 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Stop services. {{(pid=82173) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 20 17:28:51 devstack cinder-volume[82173]: DEBUG oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Killing children. {{(pid=82173) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 20 17:28:51 devstack cinder-volume[82173]: INFO oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Waiting on 1 children to exit
Apr 20 17:28:53 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Acquiring lock "singleton_lock" {{(pid=82289) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 17:28:53 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Acquired lock "singleton_lock" {{(pid=82289) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 17:28:53 devstack cinder-volume[82289]: DEBUG oslo_concurrency.lockutils [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Releasing lock "singleton_lock" {{(pid=82289) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 17:28:53 devstack cinder-volume[82289]: WARNING amqp [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 17:28:53 devstack cinder-volume[82289]: WARNING amqp [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 20 17:28:53 devstack cinder-volume[82173]: INFO oslo_service.backend._eventlet.service [None req-7eece20d-d8e9-4af9-9af3-6fc92ac70292 None None] Child 82289 exited with status 0
Apr 20 17:28:53 devstack cinder-volume[82510]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 20 17:28:53 devstack cinder-volume[82510]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 17:28:53 devstack cinder-volume[82510]: we strongly recommend against using it for new projects.
Apr 20 17:28:53 devstack cinder-volume[82510]: If you are already using Eventlet, we recommend migrating to a different
Apr 20 17:28:53 devstack cinder-volume[82510]: framework.  For more detail see
Apr 20 17:28:53 devstack cinder-volume[82510]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 17:28:53 devstack cinder-volume[82510]:   import eventlet  # noqa
Apr 20 17:28:55 devstack cinder-volume[82510]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 20 17:28:55 devstack cinder-volume[82510]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 20 17:28:55 devstack cinder-volume[82510]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82510) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 20 17:28:55 devstack cinder-volume[82510]: INFO dbcounter [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Registered counter for database cinder
Apr 20 17:28:55 devstack cinder-volume[82510]: DEBUG oslo_db.sqlalchemy.engines [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG dbcounter [-] [82510] Writer thread running {{(pid=82510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 17:28:56 devstack cinder-volume[82510]: INFO cinder.rpc [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 20 17:28:56 devstack cinder-volume[82510]: INFO cinder.rpc [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_db.sqlalchemy.engines [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:28:56 devstack cinder-volume[82510]: INFO cinder.volume.manager [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Determined volume DB was empty at startup.
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82510) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 20 17:28:56 devstack cinder-volume[82510]: WARNING stevedore.named [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 20 17:28:56 devstack cinder-volume[82510]: WARNING castellan.key_manager [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 17:28:56 devstack cinder-volume[82510]: WARNING cinder.keymgr.conf_key_mgr [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 20 17:28:56 devstack cinder-volume[82510]: INFO cinder.volume.manager [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_db.sqlalchemy.engines [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:28:56 devstack cinder-volume[82510]: INFO oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Starting 1 workers
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Started child 82690 {{(pid=82510) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Full set of CONF: {{(pid=82510) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] ******************************************************************************** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Configuration options gathered from: {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] ================================================================================ {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] allow_availability_zone_fallback = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] allow_compression_on_image_upload = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] allowed_direct_url_schemes     = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] api_rate_limit                 = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] auth_strategy                  = keystone {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_availability_zone      = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_host                   = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_name                   = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82690]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_stats_polling_interval = 60 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backup_api_class               = cinder.backup.api.API {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backup_name_template           = backup-%s {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backup_use_same_host           = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backup_use_temp_snapshot       = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] chap_password                  = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] chap_username                  =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cinder_internal_tenant_project_id = eb11abf845fa4200b0d45043c54116a7 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cinder_internal_tenant_user_id = 06e06a3f393e4da48fd3ddc088ad859a {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cluster                        = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] compression_format             = gzip {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] compute_api_class              = cinder.compute.nova.API {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] config_dir                     = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] config_source                  = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] control_exchange               = openstack {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] debug                          = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] default_availability_zone      = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] default_group_type             = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] default_volume_type            = QuobyteHD {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] disk_geometry                  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] driver_client_cert             = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] driver_client_cert_key         = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] driver_data_namespace          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] driver_ssl_cert_path           = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] driver_ssl_cert_verify         = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] driver_use_ssl                 = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] enable_new_services            = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] enable_unsupported_driver      = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] enabled_backends               = ['QuobyteHD'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] enforce_multipath_for_image_xfer = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] filter_function                = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_api_insecure            = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_api_servers             = ['http://192.168.122.198/image'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_api_ssl_compression     = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_ca_certificates_file    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_catalog_info            = image:glance:publicURL {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_certfile                = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_keyfile                 = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_num_retries             = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance_request_timeout         = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] goodness_function              = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] graceful_shutdown_timeout      = 5 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] group_api_class                = cinder.group.api.API {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] host                           = devstack {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_compress_on_upload       = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_conversion_address_space_limit = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_conversion_cpu_limit     = 60 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_conversion_disable       = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_upload_use_cinder_backend = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_upload_use_internal_tenant = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_volume_cache_enabled     = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_volume_cache_max_count   = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] image_volume_cache_max_size_gb = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] init_host_max_objects_retrieval = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] instance_format                = [instance: %(uuid)s]  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] iscsi_target_flags             =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] iscsi_write_cache              = on {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] iser_helper                    = tgtadm {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] iser_ip_address                = 192.168.122.198 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] iser_port                      = 3260 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] log_color                      = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] log_config_append              = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] log_dir                        = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] log_file                       = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] log_options                    = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] log_rotate_interval            = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] log_rotate_interval_type       = days {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] log_rotation_type              = none {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] max_age                        = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] max_logfile_count              = 30 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] max_logfile_size_mb            = 200 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] max_over_subscription_ratio    = 20.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] message_reap_interval          = 86400 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] message_ttl                    = 2592000 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] migration_create_volume_timeout_secs = 300 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] monkey_patch                   = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] monkey_patch_modules           = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] my_ip                          = 192.168.122.198 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] no_snapshot_gb_quota           = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] num_iser_scan_tries            = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] num_shell_tries                = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] num_volume_device_scan_tries   = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] nvmeof_conn_info_version       = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] nvmet_ns_id                    = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] nvmet_port_id                  = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] osapi_max_limit                = 1000 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] osapi_volume_ext_list          = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] osapi_volume_listen_port       = 8776 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] osapi_volume_use_ssl           = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] osapi_volume_workers           = 2 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] per_volume_size_limit          = -1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] periodic_fuzzy_delay           = 60 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] periodic_interval              = 60 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] public_endpoint                = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] publish_errors                 = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] quota_backup_gigabytes         = 1000 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] quota_backups                  = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] quota_gigabytes                = 1000 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] quota_groups                   = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] quota_snapshots                = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] quota_volumes                  = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] rate_limit_burst               = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] rate_limit_except_level        = CRITICAL {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] rate_limit_interval            = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] reinit_driver_count            = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] replication_device             = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] report_discard_supported       = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] report_interval                = 120 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] reservation_clean_interval     = 86400 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] reservation_expire             = 86400 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] reserved_image_namespaces      = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] reserved_percentage            = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] rpc_response_timeout           = 120 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] run_external_periodic_tasks    = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] scst_target_driver             = iscsi {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] scst_target_iqn_name           = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_down_time              = 720 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] shell_completion               = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] snapshot_name_template         = snapshot-%s {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] split_loggers                  = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] state_path                     = /opt/stack/data/cinder {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] storage_availability_zone      = nova {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] storage_protocol               = iSCSI {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] syslog_log_facility            = LOG_USER {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] target_helper                  = lioadm {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] target_ip_address              = 192.168.122.198 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] target_port                    = 3260 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] target_protocol                = iscsi {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] target_secondary_ip_addresses  = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] trace_flags                    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] transport_url                  = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] until_refresh                  = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] use_chap_auth                  = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] use_default_quota_class        = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] use_journal                    = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] use_json                       = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] use_multipath_for_image_xfer   = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] use_stderr                     = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] use_syslog                     = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] verify_glance_signatures       = enabled {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_api_class               = cinder.volume.api.API {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_backend_name            = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_clear                   = zero {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_clear_ionice            = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_clear_size              = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_copy_bps_limit          = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_dd_blocksize            = 1M {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_name_template           = volume-%s {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_service_inithost_offload = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volume_usage_audit_period      = month {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] zoning_mode                    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_concurrency.disable_process_locking = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.admin_password = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.admin_token = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.admin_user  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.auth_port   = 35357 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.auth_protocol = https {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.auth_section = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.auth_type   = password {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.auth_uri    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.auth_version = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.cache       = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.certfile    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.delay_auth_decision = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.http_connect_timeout = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.identity_uri = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.include_service_catalog = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.insecure    = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.interface   = public {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.keyfile     = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_password =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-09325944-f791-4163-afcb-52bbeacc628d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82690) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcache_username =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.region_name = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.service_token_roles_required = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.service_type = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.token_cache_time = 300 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.198/identity {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.backend                  = dogpile.cache.null {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.backend_argument         = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.backend_expiration_time  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.config_prefix            = cache.oslo {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.debug_cache_backend      = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.enable_retry_client      = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.enable_socket_keepalive  = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.enabled                  = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.enforce_fips_mode        = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.expiration_time          = 600 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.hashclient_retry_attempts = 2 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.memcache_dead_retry      = 300 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.memcache_pool_maxsize    = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.memcache_sasl_enabled    = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.password                 = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.proxies                  = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.redis_db                 = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.redis_sentinel_service_name = mymaster {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.redis_server             = localhost:6379 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.retry_attempts           = 2 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.retry_delay              = 0.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.socket_keepalive_count   = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.socket_keepalive_idle    = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.socket_keepalive_interval = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.socket_timeout           = 1.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.tls_allowed_ciphers      = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.tls_cafile               = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.tls_certfile             = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.tls_enabled              = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.tls_keyfile              = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cache.username                 = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] coordination.backend_url       = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.asyncio_connection    = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.asyncio_slave_connection = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.backend               = sqlalchemy {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.connection            = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.connection_debug      = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.connection_parameters =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.connection_recycle_time = 3600 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.connection_trace      = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.db_inc_retry_interval = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.db_max_retries        = 20 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.db_max_retry_interval = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.db_retry_interval     = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.max_overflow          = 50 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.max_pool_size         = 5 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.max_retries           = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.mysql_wsrep_sync_wait = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.pool_timeout          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.retry_interval        = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.slave_connection      = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.sqlite_synchronous    = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.synchronous_reader    = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] database.use_db_reconnect      = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.connection_string     = messaging:// {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.enabled               = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.es_doc_type           = notification {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.es_scroll_size        = 10000 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.es_scroll_time        = 2m {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.filter_error_trace    = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.hmac_keys             = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.sentinel_service_name = mymaster {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.socket_timeout        = 0.1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.trace_requests        = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler.trace_sqlalchemy      = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler_jaeger.process_tags   = {} {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler_jaeger.service_name_prefix = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] profiler_otlp.service_name_prefix = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.enforce_new_defaults = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: WARNING oslo_config.cfg [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.enforce_scope      = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.policy_default_rule = default {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.policy_file        = policy.yaml {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] privsep_osbrick.group          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] privsep_osbrick.helper_command = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] privsep_osbrick.user           = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cinder_sys_admin.group         = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cinder_sys_admin.helper_command = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] cinder_sys_admin.user          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.auth_section      = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.auth_type         = password {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.cafile            = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.certfile          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.collect_timing    = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.insecure          = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.keyfile           = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.send_service_user_token = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.split_loggers     = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] service_user.timeout           = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.auth_section            = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.auth_type               = password {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.certfile                = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.collect_timing          = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.insecure                = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.keyfile                 = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.region_name             = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.split_loggers           = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] glance.timeout                 = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.backend_availability_zone = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.chap_password = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.chap_username =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.disk_geometry = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.driver_client_cert = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.driver_client_cert_key = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.driver_data_namespace = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.driver_use_ssl = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.enable_unsupported_driver = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.extra_capabilities = {} {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.filter_function = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.goodness_function = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.iscsi_target_flags =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.iscsi_write_cache = on {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.iser_helper   = tgtadm {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.iser_ip_address = 192.168.122.198 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.iser_port     = 3260 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_host      =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_login     = admin {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_mount_options = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_password  = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_private_key =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_share_path =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.num_shell_tries = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.nvmet_port_id = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.quobyte_client_cfg = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.quobyte_volume_url = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.replication_device = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.report_discard_supported = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.reserved_percentage = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.scst_target_driver = iscsi {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.scst_target_iqn_name = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.storage_protocol = iSCSI {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.target_helper = tgtadm {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.target_ip_address = 192.168.122.198 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.target_port   = 3260 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.target_protocol = iscsi {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.trace_flags   = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.unique_fqdn_network = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.use_chap_auth = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.volume_backend_name = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.volume_clear  = zero {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.volume_clear_ionice = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.volume_clear_size = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_reports.file_event_handler = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_reports.log_dir           = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.backend_availability_zone = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.backend_host         = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.chap_password        = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.chap_username        = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.chiscsi_conf         = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.disk_geometry        = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.driver_client_cert   = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.driver_client_cert_key = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.driver_data_namespace = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.driver_use_ssl       = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.extra_capabilities   = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.filter_function      = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.goodness_function    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.iser_helper          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.iser_ip_address      = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.iser_port            = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.iser_target_prefix   = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_host             = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_login            = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_mount_options    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_password         = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_private_key      = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_share_path       = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_ssh_port         = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.num_shell_tries      = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.nvmet_port_id        = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.replication_device   = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.report_discard_supported = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.reserved_percentage  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.scst_target_driver   = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.storage_protocol     = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.target_helper        = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.target_ip_address    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.target_port          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.target_prefix        = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.target_protocol      = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.trace_flags          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.use_chap_auth        = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.volume_clear         = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.volume_clear_size    = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] QuobyteHD.volumes_dir          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.ssl      = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_notifications.driver = [] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_notifications.retry = -1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] oslo_messaging_notifications.transport_url = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] key_manager.fixed_key          = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.barbican_api_version  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.barbican_endpoint     = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.barbican_endpoint_type = public {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.barbican_region_name  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.cafile                = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.certfile              = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.collect_timing        = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.insecure              = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.keyfile               = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.number_of_retries     = 60 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.retry_delay           = 1 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.send_service_user_token = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.split_loggers         = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.timeout               = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.verify_ssl            = True {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican.verify_ssl_path       = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican_service_user.auth_section = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican_service_user.auth_type = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican_service_user.cafile   = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican_service_user.certfile = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican_service_user.collect_timing = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican_service_user.insecure = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican_service_user.keyfile  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican_service_user.split_loggers = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] barbican_service_user.timeout  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.approle_role_id          = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.approle_secret_id        = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.kv_mountpoint            = secret {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.kv_path                  = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.kv_version               = 2 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.namespace                = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.root_token_id            = **** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.ssl_ca_crt_file          = None {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.timeout                  = 60.0 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.use_ssl                  = False {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 20 17:28:56 devstack cinder-volume[82510]: DEBUG oslo_service.backend._eventlet.service [None req-ef785c5b-3e61-481e-9776-74c9c73248cb None None] ******************************************************************************** {{(pid=82510) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-09325944-f791-4163-afcb-52bbeacc628d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82690) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 20 17:28:56 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.quobyte [None req-09325944-f791-4163-afcb-52bbeacc628d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 20 17:28:56 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.quobyte [None req-09325944-f791-4163-afcb-52bbeacc628d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Running cmd (subprocess): mount.quobyte {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:28:56 devstack quobyte-client[82699]: Reading configuration file: /etc/quobyte/client.cfg
Apr 20 17:28:56 devstack quobyte-client[82699]: Invalid parameters found, error: missing mount point.
Apr 20 17:28:56 devstack quobyte-client[82699]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 20 17:28:56 devstack quobyte-client[82699]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] CMD "mount.quobyte" returned: 1 in 0.075s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:28:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:28:56 devstack sudo[82723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:28:56 devstack sudo[82723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:28:57 devstack sudo[82723]: pam_unix(sudo:session): session closed for user root
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.707s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:28:57 devstack cinder-volume[82690]: INFO cinder.volume.driver [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Driver hasn't implemented _init_vendor_properties()
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.volume.driver [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82690) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_db.sqlalchemy.engines [None req-09325944-f791-4163-afcb-52bbeacc628d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writer thread running {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.db.sqlalchemy.api [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Building query based on filter {{(pid=82690) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82690) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:28:57 devstack cinder-volume[82690]: INFO cinder.keymgr.migration [None req-91c34555-d197-4ed4-91bf-1be0b6d69d58 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 20 17:28:57 devstack sudo[82757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:28:57 devstack sudo[82757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:28:57 devstack sudo[82757]: pam_unix(sudo:session): session closed for user root
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.396s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:28:57 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Driver initialization completed successfully.
Apr 20 17:28:57 devstack cinder-volume[82690]: INFO cinder.manager [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Initiating service 3 cleanup
Apr 20 17:28:57 devstack cinder-volume[82690]: INFO cinder.manager [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Service 3 cleanup completed.
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.service [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Creating RPC server for service cinder-volume {{(pid=82690) start /opt/stack/cinder/cinder/service.py:231}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.service [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82690) start /opt/stack/cinder/cinder/service.py:237}}
Apr 20 17:28:57 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:28:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:28:57 devstack sudo[82762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:28:57 devstack sudo[82762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:28:58 devstack sudo[82762]: pam_unix(sudo:session): session closed for user root
Apr 20 17:28:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-09325944-f791-4163-afcb-52bbeacc628d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.397s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:28:58 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-09325944-f791-4163-afcb-52bbeacc628d None None] Driver post RPC initialization completed successfully.
Apr 20 17:29:06 devstack cinder-volume[82510]: DEBUG dbcounter [-] [82510] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82510) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:29:07 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:29:08 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=2 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Flow 'volume_create_manager' (9339a2b3-aa71-491c-a6aa-58c600571aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4062f8-b8dd-40a4-951d-4c465f7bed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4062f8-b8dd-40a4-951d-4c465f7bed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1647391246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b8c53b-0b16-4f65-842e-516ae266c947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09930db11054a78af396fb69f4fed8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:29:56Z,use_quota=True,user_id='f1e85271b5594ec8b2f36b67765d9271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b0c615-c073-4f84-8a32-677fca486ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b0c615-c073-4f84-8a32-677fca486ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26a0c4a-ffbd-40c3-b230-198b85f7c6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26a0c4a-ffbd-40c3-b230-198b85f7c6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b8c53b-0b16-4f65-842e-516ae266c947', 'volume_name': 'volume-b2b8c53b-0b16-4f65-842e-516ae266c947', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214d2c7d-0e34-4d92-80e2-ccf7a935ca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214d2c7d-0e34-4d92-80e2-ccf7a935ca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db268d3-3be2-470e-8bc0-e3cd3d501d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Volume b2b8c53b-0b16-4f65-842e-516ae266c947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b8c53b-0b16-4f65-842e-516ae266c947', 'volume_size': 1}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1647391246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b8c53b-0b16-4f65-842e-516ae266c947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09930db11054a78af396fb69f4fed8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:29:56Z,use_quota=True,user_id='f1e85271b5594ec8b2f36b67765d9271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Creating volume b2b8c53b-0b16-4f65-842e-516ae266c947 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:29:56 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:29:56 devstack sudo[83206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947 1073741824
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Flow 'volume_create_manager' (f3fed078-3473-4627-8dfb-52aae7a0be53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7699fb06-0d44-44de-a76a-16c305c3b711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack sudo[83206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7699fb06-0d44-44de-a76a-16c305c3b711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1284787837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4120e6b4-f6e3-4c60-95b9-a5069bd4cad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8ca9813e5214df89ac143f7e9efc40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:29:56Z,use_quota=True,user_id='4ab5bc039a614c7db036ea718bd04637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e732be-1aa6-4a48-98ad-81c4e24bccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e732be-1aa6-4a48-98ad-81c4e24bccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc1028a-4a05-4c25-9edc-12a6fffc322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc1028a-4a05-4c25-9edc-12a6fffc322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4120e6b4-f6e3-4c60-95b9-a5069bd4cad1', 'volume_name': 'volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e30aff0-2a97-4487-80d3-c92c66243fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e30aff0-2a97-4487-80d3-c92c66243fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8147e89e-4a3e-412a-9a78-7712e998c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:56 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Volume 4120e6b4-f6e3-4c60-95b9-a5069bd4cad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1', 'volume_size': 1}
Apr 20 17:29:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:29:57 devstack sudo[83206]: pam_unix(sudo:session): session closed for user root
Apr 20 17:29:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947 1073741824" returned: 0 in 1.176s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:29:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:29:57 devstack sudo[83526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947
Apr 20 17:29:57 devstack sudo[83526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:29:59 devstack sudo[83526]: pam_unix(sudo:session): session closed for user root
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947" returned: 0 in 1.735s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] <== create_volume: return (3037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.040s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.953s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1284787837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4120e6b4-f6e3-4c60-95b9-a5069bd4cad1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8ca9813e5214df89ac143f7e9efc40b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:29:56Z,use_quota=True,user_id='4ab5bc039a614c7db036ea718bd04637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Creating volume 4120e6b4-f6e3-4c60-95b9-a5069bd4cad1 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:29:59 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db268d3-3be2-470e-8bc0-e3cd3d501d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b8c53b-0b16-4f65-842e-516ae266c947', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:59 devstack sudo[83543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1 1073741824
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74470770-9dfd-4d00-96dd-d5f6ee9628e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:29:59 devstack sudo[83543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:29:59 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Volume volume-b2b8c53b-0b16-4f65-842e-516ae266c947 (b2b8c53b-0b16-4f65-842e-516ae266c947): created successfully
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74470770-9dfd-4d00-96dd-d5f6ee9628e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:29:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Flow 'volume_create_manager' (9339a2b3-aa71-491c-a6aa-58c600571aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:29:59 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c2989dd2-e3da-4554-86d9-a981a99d0f7a tempest-VolumesAdminNegativeTest-176638975 None] Created volume successfully.
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Flow 'volume_create_manager' (8e20c53f-0ffd-4c1c-a0f9-5b353be477f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5693cc3e-f445-4d37-b772-60b11339be03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5693cc3e-f445-4d37-b772-60b11339be03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:00Z,deleted=False,deleted_at=None,display_description='',display_name='c65cc747-0d72-41c6-803f-a1f09357ee8b-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8991b9-f89b-4063-a416-9c5a9a66df29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76a010116944a12ae515bb6346c2e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:00Z,use_quota=True,user_id='c4f60c0df2694952a6570fc18cf46ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2687e1be-a1a8-410a-aaec-c379907a128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2687e1be-a1a8-410a-aaec-c379907a128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48b09f8-b2ec-4c10-8024-47921932f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48b09f8-b2ec-4c10-8024-47921932f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8991b9-f89b-4063-a416-9c5a9a66df29', 'volume_name': 'volume-7f8991b9-f89b-4063-a416-9c5a9a66df29', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05e1b4d-c156-4999-9089-0e7c21310817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05e1b4d-c156-4999-9089-0e7c21310817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b8e819-eb58-4913-a713-8c28c6c8bac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:00 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Volume 7f8991b9-f89b-4063-a416-9c5a9a66df29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8991b9-f89b-4063-a416-9c5a9a66df29', 'volume_size': 1}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:00 devstack sudo[83543]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1 1073741824" returned: 0 in 1.373s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:01 devstack sudo[83589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1
Apr 20 17:30:01 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Acquiring lock "cinder-b2b8c53b-0b16-4f65-842e-516ae266c947-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Lock "cinder-b2b8c53b-0b16-4f65-842e-516ae266c947-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Acquiring lock "cinder-quobyte-b2b8c53b-0b16-4f65-842e-516ae266c947" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Lock "cinder-quobyte-b2b8c53b-0b16-4f65-842e-516ae266c947" acquired by "delete_volume" :: waited 0.038s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:01 devstack cinder-volume[82690]: INFO oslo.privsep.daemon [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi0jg22p9/privsep.sock']
Apr 20 17:30:01 devstack sudo[83594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi0jg22p9/privsep.sock
Apr 20 17:30:01 devstack sudo[83594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:01 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1" returned: 0 in 0.937s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] <== create_volume: return (2381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.399s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:00Z,deleted=False,deleted_at=None,display_description='',display_name='c65cc747-0d72-41c6-803f-a1f09357ee8b-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8991b9-f89b-4063-a416-9c5a9a66df29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76a010116944a12ae515bb6346c2e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:00Z,use_quota=True,user_id='c4f60c0df2694952a6570fc18cf46ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Creating volume 7f8991b9-f89b-4063-a416-9c5a9a66df29 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:30:01 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8147e89e-4a3e-412a-9a78-7712e998c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2045161b-7c3e-40cb-95b7-931810417cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:01 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 20 17:30:01 devstack sudo[83599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29 1073741824
Apr 20 17:30:01 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 17:30:01 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 20 17:30:01 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 17:30:01 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 20 17:30:01 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 20 17:30:01 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 17:30:01 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 17:30:01 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 20 17:30:01 devstack sudo[83599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:01 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Volume volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1 (4120e6b4-f6e3-4c60-95b9-a5069bd4cad1): created successfully
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2045161b-7c3e-40cb-95b7-931810417cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:01 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Flow 'volume_create_manager' (f3fed078-3473-4627-8dfb-52aae7a0be53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:01 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-facf001b-52ab-44a6-b6db-361fbdd381f2 req-c12be115-f142-4133-9e26-15d7e35be8a8 tempest-VolumesGetTestJSON-2039528179 None] Created volume successfully.
Apr 20 17:30:02 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 20 17:30:02 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 20 17:30:02 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 20 17:30:02 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 17:30:02 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 20 17:30:02 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 20 17:30:02 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 20 17:30:02 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 20 17:30:02 devstack cinder-volume[82690]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 20 17:30:02 devstack sudo[83599]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29 1073741824" returned: 0 in 0.823s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:02 devstack sudo[83605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29
Apr 20 17:30:02 devstack sudo[83605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:03 devstack sudo[83594]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:03 devstack cinder-volume[82690]: INFO oslo.privsep.daemon [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Spawned new privsep daemon via rootwrap
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Accepted privsep connection to /tmp/tmpi0jg22p9/privsep.sock {{(pid=82690) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 20 17:30:03 devstack cinder-volume[82690]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 20 17:30:03 devstack cinder-volume[82690]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 20 17:30:03 devstack cinder-volume[82690]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 20 17:30:03 devstack cinder-volume[82690]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83607
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f00245-e75a-418f-aead-659f38700f15]: (2,) {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e06520c-57e5-4102-b7b3-ba792ee5afd0]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:03 devstack sudo[83609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947
Apr 20 17:30:03 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Acquiring lock "cinder-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Lock "cinder-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Acquiring lock "cinder-quobyte-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Lock "cinder-quobyte-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec4398e-84d2-49c6-81ce-3bb8f3bc3521]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:03 devstack sudo[83605]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29" returned: 0 in 0.719s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b8e819-eb58-4913-a713-8c28c6c8bac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8991b9-f89b-4063-a416-9c5a9a66df29', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5c587d-75ae-4f2b-ba9d-5e2983284de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:03 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Volume volume-7f8991b9-f89b-4063-a416-9c5a9a66df29 (7f8991b9-f89b-4063-a416-9c5a9a66df29): created successfully
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da5c587d-75ae-4f2b-ba9d-5e2983284de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:03 devstack sudo[83612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1
Apr 20 17:30:03 devstack sudo[83612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Flow 'volume_create_manager' (8e20c53f-0ffd-4c1c-a0f9-5b353be477f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:03 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-aefe76fa-df3b-4d76-a85b-8abe94d14570 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Created volume successfully.
Apr 20 17:30:04 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947" returned: 0 in 1.059s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:04 devstack sudo[83612]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1" returned: 0 in 0.840s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:04 devstack sudo[83621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947
Apr 20 17:30:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:04 devstack sudo[83621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:04 devstack sudo[83623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1
Apr 20 17:30:04 devstack sudo[83623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:04 devstack sudo[83623]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1" returned: 0 in 0.498s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Lock "cinder-quobyte-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1" released by "delete_volume" :: held 1.400s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:04 devstack cinder-volume[82690]: WARNING cinder.quota [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:30:04 devstack cinder-volume[82690]: WARNING cinder.quota [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:30:04 devstack cinder-volume[82690]: DEBUG cinder.quota [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Created reservations ['52a4b0e5-0154-4299-917e-da303192e8c3', '4eb0db9b-37cd-4c24-87b5-9d574f6a43bc', '0b361d2a-e21d-43f9-8dc8-881aff8e0f27', '20ccb7ca-7823-45d2-8faf-4bc522ba322c'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:04 devstack sudo[83621]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b2b8c53b-0b16-4f65-842e-516ae266c947" returned: 0 in 0.709s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Lock "cinder-quobyte-b2b8c53b-0b16-4f65-842e-516ae266c947" released by "delete_volume" :: held 3.507s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:05 devstack sudo[83635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:30:05 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Created reservations ['2b7747fe-9cc9-4f99-8db2-0cfc38d36b3a', 'e5cb1c3b-a67b-4f86-818f-b69420971a10', '6ad2c41f-33ca-4129-bd44-dbb7532af71b', 'f83c690c-bc36-4b69-b87a-c1f4d5818e67'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:05 devstack sudo[83637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:30:05 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:05 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.920s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:05 devstack cinder-volume[82690]: DEBUG cinder.manager [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:30:05 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Deleted volume successfully.
Apr 20 17:30:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-2a85bcd2-0f59-4ba2-826c-7717d9d534a1 req-a31142b0-accc-4126-9263-fca69fca28b2 tempest-VolumesGetTestJSON-2039528179 None] Lock "cinder-4120e6b4-f6e3-4c60-95b9-a5069bd4cad1-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:06 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.865s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:06 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:30:06 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Deleted volume successfully.
Apr 20 17:30:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e09ad2b7-de02-4c30-9aab-667c3040f1c4 tempest-VolumesAdminNegativeTest-176638975 None] Lock "cinder-b2b8c53b-0b16-4f65-842e-516ae266c947-delete_volume" released by "delete_volume" :: held 4.802s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:08 devstack cinder-volume[82690]: WARNING py.warnings [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-ada9621a-f553-4dbd-b205-2b4faf3b0eff tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 20 17:30:08 devstack cinder-volume[82690]:   .first()
Apr 20 17:30:08 devstack cinder-volume[82690]: 
Apr 20 17:30:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-ada9621a-f553-4dbd-b205-2b4faf3b0eff tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-ada9621a-f553-4dbd-b205-2b4faf3b0eff tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:08 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd56b74-162c-457b-9279-3f5415880005]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-ada9621a-f553-4dbd-b205-2b4faf3b0eff tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:09 devstack sudo[83732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29
Apr 20 17:30:09 devstack sudo[83732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:09 devstack sudo[83732]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-ada9621a-f553-4dbd-b205-2b4faf3b0eff tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29" returned: 0 in 0.703s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-ada9621a-f553-4dbd-b205-2b4faf3b0eff tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.715s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-ada9621a-f553-4dbd-b205-2b4faf3b0eff tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a', 'name': 'volume-7f8991b9-f89b-4063-a416-9c5a9a66df29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d88dcc5-5542-4849-b60b-6db11931e61c', 'enforce_multipath': True} {{(pid=82690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 20 17:30:09 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-01862730-9eb4-4830-97b9-2afc9b0757f6 req-ada9621a-f553-4dbd-b205-2b4faf3b0eff tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] attachment_update completed successfully.
Apr 20 17:30:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-d56020c4-8bff-4d17-8427-bc7ea875f02a tempest-GroupSnapshotsV319Test-418044371 None] Group tempest-GroupSnapshotsV319Test-Group-7865918: creating
Apr 20 17:30:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-d56020c4-8bff-4d17-8427-bc7ea875f02a tempest-GroupSnapshotsV319Test-418044371 None] Group tempest-GroupSnapshotsV319Test-Group-7865918: created successfully
Apr 20 17:30:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-d56020c4-8bff-4d17-8427-bc7ea875f02a tempest-GroupSnapshotsV319Test-418044371 None] Create group completed successfully.
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Flow 'volume_create_manager' (89c9a23a-2003-4ecc-9549-06e90db3c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59801aa-6a27-4c47-99f0-c640c98d44de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59801aa-6a27-4c47-99f0-c640c98d44de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845662879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4c6f869f-1d3d-475b-8c07-83a1267bc1f1,host='devstack@QuobyteHD#QuobyteHD',id=422f337d-23d2-400e-b00e-a83faca2db36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c69ad88544134a6625b96044d8934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:12Z,use_quota=True,user_id='1441785916414f9bb87dd058d566ed48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f8d36b2-5479-4f72-afad-f63cde4ca6d5),volume_type_id=1f8d36b2-5479-4f72-afad-f63cde4ca6d5)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6dd57b3-88de-4571-9164-28d2c9bdaf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6dd57b3-88de-4571-9164-28d2c9bdaf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1bce65-74ff-4234-91ce-d3658cbba37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1bce65-74ff-4234-91ce-d3658cbba37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422f337d-23d2-400e-b00e-a83faca2db36', 'volume_name': 'volume-422f337d-23d2-400e-b00e-a83faca2db36', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61553e5b-ebc6-4122-abd8-8e2d778ea08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61553e5b-ebc6-4122-abd8-8e2d778ea08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a143413a-d1ad-4381-9bda-0ccb6d113e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:11 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Volume 422f337d-23d2-400e-b00e-a83faca2db36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422f337d-23d2-400e-b00e-a83faca2db36', 'volume_size': 1}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4c6f869f-1d3d-475b-8c07-83a1267bc1f1,created_at=2026-04-20T15:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-845662879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4c6f869f-1d3d-475b-8c07-83a1267bc1f1,host='devstack@QuobyteHD#QuobyteHD',id=422f337d-23d2-400e-b00e-a83faca2db36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e19c69ad88544134a6625b96044d8934',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:12Z,use_quota=True,user_id='1441785916414f9bb87dd058d566ed48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f8d36b2-5479-4f72-afad-f63cde4ca6d5),volume_type_id=1f8d36b2-5479-4f72-afad-f63cde4ca6d5)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Creating volume 422f337d-23d2-400e-b00e-a83faca2db36 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:30:11 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:30:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:11 devstack sudo[83765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36 1073741824
Apr 20 17:30:11 devstack sudo[83765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:12 devstack sudo[83765]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36 1073741824" returned: 0 in 0.587s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:12 devstack sudo[83815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36
Apr 20 17:30:12 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:12 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36" returned: 0 in 0.415s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:30:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a143413a-d1ad-4381-9bda-0ccb6d113e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422f337d-23d2-400e-b00e-a83faca2db36', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213b2f37-f168-4c6c-a262-b1bdfdc66ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:12 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Volume volume-422f337d-23d2-400e-b00e-a83faca2db36 (422f337d-23d2-400e-b00e-a83faca2db36): created successfully
Apr 20 17:30:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213b2f37-f168-4c6c-a262-b1bdfdc66ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Flow 'volume_create_manager' (89c9a23a-2003-4ecc-9549-06e90db3c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-61acb08f-6ad8-41d5-ad9c-991595bf6dc1 tempest-GroupSnapshotsV319Test-418044371 None] Created volume successfully.
Apr 20 17:30:14 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] GroupSnapshot db2e4f2b-caf2-426f-bbc4-d6653e47ef3e: creating.
Apr 20 17:30:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Group snapshot db2e4f2b-caf2-426f-bbc4-d6653e47ef3e: creating. {{(pid=82690) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 17:30:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Creating offline snapshot 188b6357-3038-455c-9c68-ccc419d463ac of volume 422f337d-23d2-400e-b00e-a83faca2db36 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:30:14 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b984b52-9206-4ff5-aebf-f361d2a0e087]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:14 devstack sudo[83862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36
Apr 20 17:30:14 devstack sudo[83862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:15 devstack sudo[83862]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36" returned: 0 in 1.376s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:15 devstack sudo[84206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac 1G
Apr 20 17:30:15 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Flow 'volume_create_manager' (036351f2-acaf-4ca5-86e8-aeccd991ecd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bded4476-87c0-48e5-b85f-1f879286d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bded4476-87c0-48e5-b85f-1f879286d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1485041687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cead9d-1ea2-4306-bff8-3794cd7651c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93d54526048446ebbe7ab1e0bb80cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:16Z,use_quota=True,user_id='ac70a26a101d45da81073f06719f07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8189ce15-b342-4ea2-9b2d-2086a3d32a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8189ce15-b342-4ea2-9b2d-2086a3d32a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295a6ce3-6ce7-4f44-9bac-6b2fee4c2e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295a6ce3-6ce7-4f44-9bac-6b2fee4c2e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cead9d-1ea2-4306-bff8-3794cd7651c6', 'volume_name': 'volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb76852-74fd-43c3-bde0-e29511972160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb76852-74fd-43c3-bde0-e29511972160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9615932-7853-4ecf-95ee-cb89ec340f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:16 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Volume e9cead9d-1ea2-4306-bff8-3794cd7651c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6', 'volume_size': 1}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:16 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac 1G" returned: 0 in 0.952s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422f337d-23d2-400e-b00e-a83faca2db36 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:16 devstack sudo[84215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422f337d-23d2-400e-b00e-a83faca2db36 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac
Apr 20 17:30:16 devstack sudo[84215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:17 devstack sudo[84215]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422f337d-23d2-400e-b00e-a83faca2db36 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac" returned: 0 in 0.579s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:17 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:30:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:17 devstack sudo[84221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac
Apr 20 17:30:17 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:17 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac" returned: 0 in 0.585s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:18 devstack sudo[84225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.info
Apr 20 17:30:18 devstack sudo[84225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:18 devstack sudo[84225]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.info" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:18 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:30:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:18 devstack sudo[84228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.info
Apr 20 17:30:18 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:18 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.info" returned: 0 in 0.479s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.585s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.359s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1485041687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cead9d-1ea2-4306-bff8-3794cd7651c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c93d54526048446ebbe7ab1e0bb80cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:16Z,use_quota=True,user_id='ac70a26a101d45da81073f06719f07ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Creating volume e9cead9d-1ea2-4306-bff8-3794cd7651c6 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:30:19 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:19 devstack sudo[84233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6 1073741824
Apr 20 17:30:19 devstack sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:19 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-18c9679a-da98-498e-82de-1dcd6775c382 tempest-GroupSnapshotsV319Test-418044371 None] group_snapshot db2e4f2b-caf2-426f-bbc4-d6653e47ef3e: created successfully
Apr 20 17:30:19 devstack sudo[84233]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6 1073741824" returned: 0 in 0.621s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:19 devstack sudo[84238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6
Apr 20 17:30:19 devstack sudo[84238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:19 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] group_snapshot db2e4f2b-caf2-426f-bbc4-d6653e47ef3e: deleting
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] group_snapshot db2e4f2b-caf2-426f-bbc4-d6653e47ef3e: deleting {{(pid=82690) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 17:30:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Acquiring lock "cinder-quobyte-422f337d-23d2-400e-b00e-a83faca2db36" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Lock "cinder-quobyte-422f337d-23d2-400e-b00e-a83faca2db36" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Acquiring lock "cinder-quobyte-188b6357-3038-455c-9c68-ccc419d463ac" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Lock "cinder-quobyte-188b6357-3038-455c-9c68-ccc419d463ac" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Deleting offline snapshot 188b6357-3038-455c-9c68-ccc419d463ac of volume 422f337d-23d2-400e-b00e-a83faca2db36 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] snapshot_file for this snap is: volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec2253e-1cf3-48fe-8bb7-ca891b4b5647]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:20 devstack sudo[84240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac
Apr 20 17:30:20 devstack sudo[84240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:20 devstack sudo[84238]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6" returned: 0 in 0.817s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9615932-7853-4ecf-95ee-cb89ec340f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57be1d07-4106-4f92-8b3d-3ea8d9230896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:20 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Volume volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6 (e9cead9d-1ea2-4306-bff8-3794cd7651c6): created successfully
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57be1d07-4106-4f92-8b3d-3ea8d9230896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Flow 'volume_create_manager' (036351f2-acaf-4ca5-86e8-aeccd991ecd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:20 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-499dee51-0381-41d2-b07d-aa1dd5f19c9d tempest-DeleteServersTestJSON-1166568470 None] Created volume successfully.
Apr 20 17:30:20 devstack sudo[84240]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac" returned: 0 in 0.823s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-422f337d-23d2-400e-b00e-a83faca2db36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c89204-ead1-43e8-91a0-947dc0c32a27]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:21 devstack sudo[84252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36
Apr 20 17:30:21 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:21 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36" returned: 0 in 0.581s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:21 devstack sudo[84258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac
Apr 20 17:30:21 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:22 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac" returned: 0 in 0.563s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:22 devstack sudo[84263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac
Apr 20 17:30:22 devstack sudo[84263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:22 devstack sudo[84263]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36.188b6357-3038-455c-9c68-ccc419d463ac" returned: 0 in 0.529s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Lock "cinder-quobyte-188b6357-3038-455c-9c68-ccc419d463ac" released by "_delete_snapshot" :: held 2.572s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Lock "cinder-quobyte-422f337d-23d2-400e-b00e-a83faca2db36" released by "delete_snapshot" :: held 2.594s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:22 devstack cinder-volume[82690]: WARNING cinder.quota [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2022437265 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2022437265, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:30:22 devstack cinder-volume[82690]: WARNING cinder.quota [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2022437265 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2022437265, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:30:22 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] Created reservations ['2cbe435d-0488-4b7c-aab3-027946fd9bb2', 'd9706aff-16b1-43b1-9944-a5c1d3c48128', 'f8f0e46d-2ac9-460e-854c-4c81791c687a', 'c4b5fd98-131c-4b07-9f22-e1e82a14b950'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a57b11e0-a491-4f94-a88e-b6751c07c178 tempest-GroupSnapshotsV319Test-418044371 None] group_snapshot db2e4f2b-caf2-426f-bbc4-d6653e47ef3e: deleted successfully
Apr 20 17:30:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Acquiring lock "cinder-quobyte-422f337d-23d2-400e-b00e-a83faca2db36" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Lock "cinder-quobyte-422f337d-23d2-400e-b00e-a83faca2db36" acquired by "delete_volume" :: waited 0.039s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:23 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[45079c7a-e471-40bb-a981-f0a8429d7c6f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:24 devstack sudo[84296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36
Apr 20 17:30:24 devstack sudo[84296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-d157dd91-87d3-4960-ac8c-5c5b96862127 req-ea2a8a05-8bca-4024-961d-1075759a0797 tempest-DeleteServersTestJSON-1166568470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-d157dd91-87d3-4960-ac8c-5c5b96862127 req-ea2a8a05-8bca-4024-961d-1075759a0797 tempest-DeleteServersTestJSON-1166568470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:24 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a92e01-566e-4f6d-8e5b-cad4eb382f0f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-d157dd91-87d3-4960-ac8c-5c5b96862127 req-ea2a8a05-8bca-4024-961d-1075759a0797 tempest-DeleteServersTestJSON-1166568470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:24 devstack sudo[84303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6
Apr 20 17:30:24 devstack sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:24 devstack sudo[84296]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36" returned: 0 in 0.853s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:24 devstack sudo[84308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36
Apr 20 17:30:24 devstack sudo[84308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:25 devstack sudo[84303]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-d157dd91-87d3-4960-ac8c-5c5b96862127 req-ea2a8a05-8bca-4024-961d-1075759a0797 tempest-DeleteServersTestJSON-1166568470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6" returned: 0 in 0.940s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-d157dd91-87d3-4960-ac8c-5c5b96862127 req-ea2a8a05-8bca-4024-961d-1075759a0797 tempest-DeleteServersTestJSON-1166568470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.980s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d157dd91-87d3-4960-ac8c-5c5b96862127 req-ea2a8a05-8bca-4024-961d-1075759a0797 tempest-DeleteServersTestJSON-1166568470 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a', 'name': 'volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd46da2d-86b4-41e0-8624-b1d21ac8ce54', 'enforce_multipath': True} {{(pid=82690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 20 17:30:25 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-d157dd91-87d3-4960-ac8c-5c5b96862127 req-ea2a8a05-8bca-4024-961d-1075759a0797 tempest-DeleteServersTestJSON-1166568470 None] attachment_update completed successfully.
Apr 20 17:30:25 devstack sudo[84308]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-422f337d-23d2-400e-b00e-a83faca2db36" returned: 0 in 0.805s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Lock "cinder-quobyte-422f337d-23d2-400e-b00e-a83faca2db36" released by "delete_volume" :: held 1.778s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Created reservations ['460cf775-4a0c-425d-8eb0-a4ce5e12b089'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:25 devstack cinder-volume[82690]: WARNING cinder.quota [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2022437265 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2022437265, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Created reservations ['076958dd-e277-4c8e-97e5-51aba1a005e5', 'ab207005-eb6b-4144-a88a-7e58fa8ed89c', '55d2191f-6490-4ec2-943e-c4c015c8c5d9', 'e593a108-a671-4b74-a649-136d29dd166c'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:25 devstack sudo[84334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:30:25 devstack sudo[84334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:26 devstack sudo[84334]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.616s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:26 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:30:26 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-62db7708-a768-4554-b4e5-6982b5fa8991 tempest-GroupSnapshotsV319Test-418044371 None] Delete group completed successfully.
Apr 20 17:30:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2113ed3c-fc08-4283-a659-90fd928c5dd3 tempest-BackendsCapabilitiesAdminTestsJSON-592179583 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82690) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 20 17:30:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f57626da-7c53-4848-b724-dc3e9a435d7e tempest-BackendsCapabilitiesAdminTestsJSON-592179583 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82690) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 20 17:30:34 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-c0999eeb-ee88-4f87-a898-2454911f43d3 req-cf85a3cf-fb84-4c91-9778-ed5f1f690380 tempest-DeleteServersTestJSON-1166568470 None] Terminate volume connection completed successfully.
Apr 20 17:30:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-c0999eeb-ee88-4f87-a898-2454911f43d3 req-cf85a3cf-fb84-4c91-9778-ed5f1f690380 tempest-DeleteServersTestJSON-1166568470 None] Deleting attachment fd46da2d-86b4-41e0-8624-b1d21ac8ce54. {{(pid=82690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 20 17:30:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6668cbfe-139a-4270-9cf3-9f0da92585ab tempest-GroupsV314Test-1312565541 None] Group tempest-GroupsV314Test-Group-163955473: creating
Apr 20 17:30:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6668cbfe-139a-4270-9cf3-9f0da92585ab tempest-GroupsV314Test-1312565541 None] Group tempest-GroupsV314Test-Group-163955473: created successfully
Apr 20 17:30:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6668cbfe-139a-4270-9cf3-9f0da92585ab tempest-GroupsV314Test-1312565541 None] Create group completed successfully.
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Flow 'volume_create_manager' (23c8fc6b-0076-4d8e-b5e2-e131a193c076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915068a4-6371-410e-8b79-a0c5e01dd716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915068a4-6371-410e-8b79-a0c5e01dd716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-710833122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c23a90b2-8069-4861-902b-8ae005ccc383,host='devstack@QuobyteHD#QuobyteHD',id=0f165b09-6ce1-44d9-932a-6982af787117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0f0bcd93044668aaf57983a8dfb340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:37Z,use_quota=True,user_id='acd19e1916304e08bf350a012f4f5e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c993c15f-4864-4c95-8801-15e29eaae828),volume_type_id=c993c15f-4864-4c95-8801-15e29eaae828)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74bab15-ce27-4129-b77a-b03d0f3cfb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74bab15-ce27-4129-b77a-b03d0f3cfb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c84741-a900-434e-b260-5203eb25dcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c84741-a900-434e-b260-5203eb25dcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f165b09-6ce1-44d9-932a-6982af787117', 'volume_name': 'volume-0f165b09-6ce1-44d9-932a-6982af787117', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715426b1-82a5-41d5-b5e6-caf8f1f9b94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715426b1-82a5-41d5-b5e6-caf8f1f9b94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbed9a67-a477-412b-95cd-a658af694602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:37 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Volume 0f165b09-6ce1-44d9-932a-6982af787117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f165b09-6ce1-44d9-932a-6982af787117', 'volume_size': 1}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c23a90b2-8069-4861-902b-8ae005ccc383,created_at=2026-04-20T15:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-710833122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c23a90b2-8069-4861-902b-8ae005ccc383,host='devstack@QuobyteHD#QuobyteHD',id=0f165b09-6ce1-44d9-932a-6982af787117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c0f0bcd93044668aaf57983a8dfb340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:37Z,use_quota=True,user_id='acd19e1916304e08bf350a012f4f5e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c993c15f-4864-4c95-8801-15e29eaae828),volume_type_id=c993c15f-4864-4c95-8801-15e29eaae828)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Creating volume 0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:30:37 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:37 devstack sudo[84479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 1073741824
Apr 20 17:30:37 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:37 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 1073741824" returned: 0 in 0.536s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:37 devstack sudo[84484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117
Apr 20 17:30:37 devstack sudo[84484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:38 devstack sudo[84484]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117" returned: 0 in 0.506s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbed9a67-a477-412b-95cd-a658af694602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f165b09-6ce1-44d9-932a-6982af787117', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cb5957-8990-441c-abba-a6640e9fe849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:38 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Volume volume-0f165b09-6ce1-44d9-932a-6982af787117 (0f165b09-6ce1-44d9-932a-6982af787117): created successfully
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cb5957-8990-441c-abba-a6640e9fe849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Flow 'volume_create_manager' (23c8fc6b-0076-4d8e-b5e2-e131a193c076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:38 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ac1775bd-1209-4fa3-b675-2c853506c080 tempest-GroupsV314Test-1312565541 None] Created volume successfully.
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Acquiring lock "cinder-e9cead9d-1ea2-4306-bff8-3794cd7651c6-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Lock "cinder-e9cead9d-1ea2-4306-bff8-3794cd7651c6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Acquiring lock "cinder-quobyte-e9cead9d-1ea2-4306-bff8-3794cd7651c6" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Lock "cinder-quobyte-e9cead9d-1ea2-4306-bff8-3794cd7651c6" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db6a31-55c1-4870-8b8a-4d669b8a85d0]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:38 devstack sudo[84491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6
Apr 20 17:30:38 devstack sudo[84491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:38 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-437718be-b7ce-4bac-84db-57e398a99862 tempest-GroupsV320Test-1417949590 None] Group tempest-GroupsV320Test-Group-1460989172: creating
Apr 20 17:30:38 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-437718be-b7ce-4bac-84db-57e398a99862 tempest-GroupsV320Test-1417949590 None] Group tempest-GroupsV320Test-Group-1460989172: created successfully
Apr 20 17:30:38 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-437718be-b7ce-4bac-84db-57e398a99862 tempest-GroupsV320Test-1417949590 None] Create group completed successfully.
Apr 20 17:30:39 devstack sudo[84491]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6" returned: 0 in 0.514s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:39 devstack sudo[84498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6
Apr 20 17:30:39 devstack sudo[84498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:39 devstack sudo[84498]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e9cead9d-1ea2-4306-bff8-3794cd7651c6" returned: 0 in 0.427s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Lock "cinder-quobyte-e9cead9d-1ea2-4306-bff8-3794cd7651c6" released by "delete_volume" :: held 0.983s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Created reservations ['0b66dcb6-80ee-4e59-9e78-562454cec2ed', '86aeae1b-5a2a-4ecf-baa1-0ce4c010affa', '0144f519-2e40-40e7-8ab0-015ef8e35b13', '4bfb6194-de12-4690-bee7-e97ddc9ad79e'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:39 devstack sudo[84501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:30:39 devstack sudo[84501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] Created reservations ['1b7bbc41-aa7d-4eee-87ed-3b2bf7d768f8'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:40 devstack sudo[84501]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.419s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:30:40 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Deleted volume successfully.
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8e1b9d6f-7383-4e68-bc79-21e995ee18dc tempest-DeleteServersTestJSON-1166568470 None] Lock "cinder-e9cead9d-1ea2-4306-bff8-3794cd7651c6-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:40 devstack sudo[84504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:30:40 devstack sudo[84504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:40 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Cloning volume 0f165b09-6ce1-44d9-932a-6982af787117 to volume eaa68462-3f2d-4456-adaa-e86e214acef6
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Creating offline snapshot 0e0d229f-e8b7-4971-b0da-913fa1fc0c77 of volume 0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec947d5-f933-46da-94c9-e28f458b2551]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:40 devstack sudo[84506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117
Apr 20 17:30:40 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:40 devstack sudo[84504]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.485s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:30:40 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0554cea6-b3f4-458f-b300-feb0362da7c6 tempest-GroupsV320Test-1417949590 None] Delete group completed successfully.
Apr 20 17:30:40 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117" returned: 0 in 0.522s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:41 devstack sudo[84512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 1G
Apr 20 17:30:41 devstack sudo[84512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:41 devstack sudo[84512]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 1G" returned: 0 in 0.627s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f165b09-6ce1-44d9-932a-6982af787117 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:41 devstack sudo[84517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f165b09-6ce1-44d9-932a-6982af787117 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77
Apr 20 17:30:41 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:42 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f165b09-6ce1-44d9-932a-6982af787117 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77" returned: 0 in 0.512s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:42 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:30:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:42 devstack sudo[84523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77
Apr 20 17:30:42 devstack sudo[84523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:42 devstack sudo[84523]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77" returned: 0 in 0.418s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:42 devstack sudo[84528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.info
Apr 20 17:30:42 devstack sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:43 devstack sudo[84528]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.info" returned: 0 in 0.584s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:43 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:43 devstack sudo[84532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.info
Apr 20 17:30:43 devstack sudo[84532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:43 devstack sudo[84534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:30:43 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:43 devstack sudo[84532]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.info" returned: 0 in 0.533s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Acquiring lock "cinder-quobyte-eaa68462-3f2d-4456-adaa-e86e214acef6" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Lock "cinder-quobyte-eaa68462-3f2d-4456-adaa-e86e214acef6" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] snapshot: 0e0d229f-e8b7-4971-b0da-913fa1fc0c77, volume: eaa68462-3f2d-4456-adaa-e86e214acef6,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0e37f6-5c18-49d3-97db-a49a92024cdc]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:43 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.580s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:30:43 devstack sudo[84539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77
Apr 20 17:30:43 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:44 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77" returned: 0 in 0.750s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f165b09-6ce1-44d9-932a-6982af787117(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:30:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:30:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:30:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e52bc30-4278-4f9f-910f-6a41bf109b2a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:44 devstack sudo[84544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117
Apr 20 17:30:44 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:45 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117" returned: 0 in 0.677s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:45 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6 not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:30:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:45 devstack sudo[84561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6
Apr 20 17:30:45 devstack sudo[84561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:46 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:30:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Flow 'volume_create_manager' (20518f67-4189-47ab-a99b-84370379586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50204244-b3b3-4cc9-ad49-efa981091db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50204244-b3b3-4cc9-ad49-efa981091db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1937481309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4dc2d8-4a44-41c5-9179-2f2d5e215a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95783a5398e4df9a82906cba39d3e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:47Z,use_quota=True,user_id='34d78591818b4a22b513fb108a465a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9700ba8-e75f-4747-8b7a-bffd899d1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9700ba8-e75f-4747-8b7a-bffd899d1b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119cbd54-7ce5-4fa1-a229-0960832cd4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (119cbd54-7ce5-4fa1-a229-0960832cd4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4dc2d8-4a44-41c5-9179-2f2d5e215a24', 'volume_name': 'volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5a6c0a-17a1-40cd-b1dd-065325177150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5a6c0a-17a1-40cd-b1dd-065325177150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b8bc4b-0389-40b3-a781-857d5df991dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:47 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Volume 4f4dc2d8-4a44-41c5-9179-2f2d5e215a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24', 'volume_size': 1}
Apr 20 17:30:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:48 devstack sudo[84561]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6" returned: 0 in 2.852s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:48 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f63571d-f365-48ef-8e53-fe891d5587a8]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:48 devstack sudo[84596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117
Apr 20 17:30:48 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:48 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117" returned: 0 in 0.720s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:48 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117, size 1024.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:30:48 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Converted 1024.00 MB image at 358.93 MB/s
Apr 20 17:30:48 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:30:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:48 devstack sudo[84604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6
Apr 20 17:30:48 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:49 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6" returned: 0 in 0.480s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Lock "cinder-quobyte-eaa68462-3f2d-4456-adaa-e86e214acef6" released by "_copy_volume_from_snapshot" :: held 5.559s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=76,cinder:UPDATE=76,cinder:DELETE=5,cinder:INSERT=15 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Acquiring lock "cinder-quobyte-0e0d229f-e8b7-4971-b0da-913fa1fc0c77" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Lock "cinder-quobyte-0e0d229f-e8b7-4971-b0da-913fa1fc0c77" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Deleting offline snapshot 0e0d229f-e8b7-4971-b0da-913fa1fc0c77 of volume 0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] snapshot_file for this snap is: volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5c7b65-d19d-4d81-9771-1ffe3fc8e978]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:49 devstack sudo[84607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77
Apr 20 17:30:49 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:49 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77" returned: 0 in 0.487s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f165b09-6ce1-44d9-932a-6982af787117(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[31470d1c-e853-457c-99a8-6629ecd97416]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:49 devstack sudo[84612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117
Apr 20 17:30:49 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:50 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117" returned: 0 in 0.690s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:50 devstack sudo[84644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77
Apr 20 17:30:50 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:50 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:UPDATE=66,cinder:SELECT=79,cinder:INSERT=16,cinder:DELETE=4 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Flow 'volume_create_manager' (b3573b40-c7c7-43c8-9b5a-442f5ba3324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474db5a4-96d8-4522-b95d-7ac1a60cca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474db5a4-96d8-4522-b95d-7ac1a60cca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-76235753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84727056-cadf-4e6b-b277-cccbc22dff42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434be7927a164c80b138fde140795fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:51Z,use_quota=True,user_id='5db6e19985164aa99a607d420565bdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e090fc0-864c-4836-9fab-4fe70b6f5049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e090fc0-864c-4836-9fab-4fe70b6f5049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af08a915-c492-40b9-a4a7-163811ed3898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af08a915-c492-40b9-a4a7-163811ed3898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84727056-cadf-4e6b-b277-cccbc22dff42', 'volume_name': 'volume-84727056-cadf-4e6b-b277-cccbc22dff42', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a1bd48-a354-4778-afcd-8fda78fc3909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a1bd48-a354-4778-afcd-8fda78fc3909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ab49ab-802c-4176-a5db-0686fb0f2184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:51 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Volume 84727056-cadf-4e6b-b277-cccbc22dff42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84727056-cadf-4e6b-b277-cccbc22dff42', 'volume_size': 1}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:51 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77" returned: 0 in 0.701s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:51 devstack sudo[84651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77
Apr 20 17:30:51 devstack sudo[84651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:51 devstack sudo[84651]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117.0e0d229f-e8b7-4971-b0da-913fa1fc0c77" returned: 0 in 0.443s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Lock "cinder-quobyte-0e0d229f-e8b7-4971-b0da-913fa1fc0c77" released by "_delete_snapshot" :: held 2.372s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.274s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.687s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1937481309',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4dc2d8-4a44-41c5-9179-2f2d5e215a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95783a5398e4df9a82906cba39d3e31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:47Z,use_quota=True,user_id='34d78591818b4a22b513fb108a465a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Creating volume 4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:30:51 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:30:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:51 devstack sudo[84654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 1073741824
Apr 20 17:30:51 devstack sudo[84654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:51 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3c070b5a-c1da-46be-91a7-3559d4b763ae tempest-GroupsV314Test-1312565541 None] Create group from source-group-c23a90b2-8069-4861-902b-8ae005ccc383 completed successfully.
Apr 20 17:30:52 devstack sudo[84654]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 1073741824" returned: 0 in 0.553s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:52 devstack sudo[84659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24
Apr 20 17:30:52 devstack sudo[84659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:52 devstack sudo[84659]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" returned: 0 in 0.485s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-76235753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84727056-cadf-4e6b-b277-cccbc22dff42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='434be7927a164c80b138fde140795fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:30:51Z,use_quota=True,user_id='5db6e19985164aa99a607d420565bdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Creating volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:30:52 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:52 devstack sudo[84663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42 1073741824
Apr 20 17:30:52 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b8bc4b-0389-40b3-a781-857d5df991dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d0452f-a6ed-489f-88a4-c3356908f2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:52 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Volume volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 (4f4dc2d8-4a44-41c5-9179-2f2d5e215a24): created successfully
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d0452f-a6ed-489f-88a4-c3356908f2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Flow 'volume_create_manager' (20518f67-4189-47ab-a99b-84370379586c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:52 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-d990832f-f18e-4ce7-841a-e2ce96d799e5 req-5ab45f75-32e6-4998-90a9-153107bc8606 tempest-VolumesSnapshotsTestJSON-1299424136 None] Created volume successfully.
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Acquiring lock "cinder-quobyte-eaa68462-3f2d-4456-adaa-e86e214acef6" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Lock "cinder-quobyte-eaa68462-3f2d-4456-adaa-e86e214acef6" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf62b14-3158-4c35-9b96-a95c20c5a225]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:53 devstack sudo[84665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6
Apr 20 17:30:53 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:53 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42 1073741824" returned: 0 in 0.715s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:53 devstack sudo[84674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42
Apr 20 17:30:53 devstack sudo[84674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:53 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6" returned: 0 in 0.648s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:53 devstack sudo[84676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6
Apr 20 17:30:53 devstack sudo[84676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:53 devstack sudo[84674]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42" returned: 0 in 0.451s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.497s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ab49ab-802c-4176-a5db-0686fb0f2184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84727056-cadf-4e6b-b277-cccbc22dff42', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188f83dc-0d79-43a3-a781-18e543249979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:30:54 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Volume volume-84727056-cadf-4e6b-b277-cccbc22dff42 (84727056-cadf-4e6b-b277-cccbc22dff42): created successfully
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188f83dc-0d79-43a3-a781-18e543249979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Flow 'volume_create_manager' (b3573b40-c7c7-43c8-9b5a-442f5ba3324e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Creating offline snapshot 75f2044c-167d-42eb-a970-884dd6b6bb47 of volume 4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:30:54 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-bb9d093b-114d-48d2-b029-84357912af1d tempest-SnapshotsActionsTest-1722502918 None] Created volume successfully.
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[217f5e4b-5ae6-42cc-9f7d-b8df31c0a9ec]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:54 devstack sudo[84676]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eaa68462-3f2d-4456-adaa-e86e214acef6" returned: 0 in 0.512s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:54 devstack sudo[84680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Lock "cinder-quobyte-eaa68462-3f2d-4456-adaa-e86e214acef6" released by "delete_volume" :: held 1.186s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:54 devstack sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Created reservations ['9389bfcd-65bd-4b42-b6b9-8c3ec6885f5e'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:54 devstack cinder-volume[82690]: WARNING cinder.quota [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-870743625 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-870743625, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:30:54 devstack cinder-volume[82690]: WARNING cinder.quota [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-870743625 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-870743625, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Created reservations ['32181393-2b8c-41b3-acb8-f4c997fbee06', '2280fe83-6f49-43d8-a3b0-d56dccadf06f', 'd8d7a2fe-fd2b-43d0-843d-2adff4e243f4', '0339ba50-8a15-4f73-99bf-025608aba5e2'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:54 devstack sudo[84683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:30:54 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:54 devstack sudo[84680]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" returned: 0 in 0.623s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:54 devstack sudo[84688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 1G
Apr 20 17:30:54 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:54 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.494s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:54 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:30:54 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-74357e2e-53c5-4d2d-bb3b-18e7761cd01a tempest-GroupsV314Test-1312565541 None] Delete group completed successfully.
Apr 20 17:30:55 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 1G" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:55 devstack sudo[84700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47
Apr 20 17:30:55 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Acquiring lock "cinder-quobyte-0f165b09-6ce1-44d9-932a-6982af787117" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Lock "cinder-quobyte-0f165b09-6ce1-44d9-932a-6982af787117" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75434a1-b3a4-4f96-ba9c-3b30d12d5a44]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:55 devstack sudo[84702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117
Apr 20 17:30:55 devstack sudo[84702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:55 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47" returned: 0 in 0.472s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:55 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 is being set with open permissions: ugo+rw
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:55 devstack sudo[84707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47
Apr 20 17:30:55 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:55 devstack sudo[84702]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117" returned: 0 in 0.546s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:55 devstack sudo[84712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117
Apr 20 17:30:55 devstack sudo[84712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:56 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47" returned: 0 in 0.431s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:56 devstack sudo[84716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.info
Apr 20 17:30:56 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:56 devstack sudo[84712]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f165b09-6ce1-44d9-932a-6982af787117" returned: 0 in 0.437s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Lock "cinder-quobyte-0f165b09-6ce1-44d9-932a-6982af787117" released by "delete_volume" :: held 1.031s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Created reservations ['f521df48-ab8b-4afd-b09c-201e995afdfb'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Created reservations ['20d0c5eb-9461-4cbe-ae89-7217b9f76e77', '9a2c8adb-eb2b-4988-aeb3-ab25bbecc184', '0a9beaee-b93b-4a05-9886-911ff36ae621', '77e8760f-b737-4409-b594-b3779b6adec4'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:56 devstack sudo[84729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:30:56 devstack sudo[84729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:56 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.info" returned: 0 in 0.533s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:56 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.info is being set with open permissions: ugo+rw
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:56 devstack sudo[84739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.info
Apr 20 17:30:56 devstack sudo[84739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:56 devstack sudo[84729]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.450s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:56 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:30:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f910fb66-0161-4397-a633-e8fd62d612d8 tempest-GroupsV314Test-1312565541 None] Delete group completed successfully.
Apr 20 17:30:57 devstack sudo[84739]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.info" returned: 0 in 0.521s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.174s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:30:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.767s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:30:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Creating offline snapshot 7e405b1c-8c08-4f28-95d7-022d1b9d8212 of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:30:57 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-13254bd9-fee2-4238-8e72-f8830055e788 req-225b47b1-ce48-4e7e-8ac8-ba33abc5d84f tempest-VolumesSnapshotsTestJSON-1299424136 None] Create snapshot completed successfully
Apr 20 17:30:57 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dffd366-a3aa-416f-b77f-a57415249e86]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:57 devstack sudo[84747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42
Apr 20 17:30:57 devstack sudo[84747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:57 devstack sudo[84747]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42" returned: 0 in 0.592s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:57 devstack sudo[84752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 1G
Apr 20 17:30:57 devstack sudo[84752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Acquiring lock "cinder-75f2044c-167d-42eb-a970-884dd6b6bb47-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-75f2044c-167d-42eb-a970-884dd6b6bb47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Acquiring lock "cinder-quobyte-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-quobyte-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Acquiring lock "cinder-quobyte-75f2044c-167d-42eb-a970-884dd6b6bb47" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-quobyte-75f2044c-167d-42eb-a970-884dd6b6bb47" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Deleting offline snapshot 75f2044c-167d-42eb-a970-884dd6b6bb47 of volume 4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] snapshot_file for this snap is: volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbc4d2f-e737-4c0a-ae75-94ebea314966]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:58 devstack sudo[84754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47
Apr 20 17:30:58 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:58 devstack sudo[84752]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 1G" returned: 0 in 0.986s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:58 devstack sudo[84759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:30:58 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:59 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47" returned: 0 in 0.893s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:30:59 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc4edf3-4e16-4a98-af09-d4182096af0c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:30:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:59 devstack sudo[84764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24
Apr 20 17:30:59 devstack sudo[84764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:59 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.792s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:59 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 is being set with open permissions: ugo+rw
Apr 20 17:30:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:59 devstack sudo[84769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:30:59 devstack sudo[84769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:30:59 devstack sudo[84764]: pam_unix(sudo:session): session closed for user root
Apr 20 17:30:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" returned: 0 in 0.715s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:30:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:30:59 devstack sudo[84774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47
Apr 20 17:30:59 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:00 devstack sudo[84769]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.507s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:00 devstack sudo[84777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.info
Apr 20 17:31:00 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:00 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47" returned: 0 in 0.578s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:00 devstack sudo[84782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47
Apr 20 17:31:00 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:01 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.info" returned: 0 in 0.910s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:01 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.info is being set with open permissions: ugo+rw
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:01 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24.75f2044c-167d-42eb-a970-884dd6b6bb47" returned: 0 in 0.666s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:01 devstack sudo[84818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.info
Apr 20 17:31:01 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-quobyte-75f2044c-167d-42eb-a970-884dd6b6bb47" released by "_delete_snapshot" :: held 3.013s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-quobyte-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" released by "delete_snapshot" :: held 3.031s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:01 devstack cinder-volume[82690]: WARNING cinder.quota [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG cinder.quota [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Created reservations ['20ef3d62-08e1-48ec-ba8e-55fbc4cd4dc8', 'b9f138a8-7a47-42df-81bb-9e3cfc7c0927', 'f7d00cf1-5f95-4998-b99b-4ae29a81fded', 'e3884072-75b7-4972-a6a5-00ac9573d67e'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:01 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Delete snapshot completed successfully.
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-fc62ef32-c6b7-4fe1-96dc-81d93621a959 req-6ee98cdd-10e8-40e3-b562-fcf2c95e217b tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-75f2044c-167d-42eb-a970-884dd6b6bb47-delete_snapshot" released by "delete_snapshot" :: held 3.214s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Acquiring lock "cinder-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Acquiring lock "cinder-quobyte-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-quobyte-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" acquired by "delete_volume" :: waited 0.021s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f6852a-33c4-4249-b84e-f11686461a94]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:01 devstack sudo[84822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24
Apr 20 17:31:01 devstack sudo[84822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:01 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.info" returned: 0 in 0.716s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.604s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:01 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-bc2be29d-75f7-4060-a82c-475eb2d85e57 tempest-SnapshotsActionsTest-1722502918 None] Create snapshot completed successfully
Apr 20 17:31:02 devstack sudo[84822]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" returned: 0 in 0.773s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:02 devstack sudo[84832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24
Apr 20 17:31:02 devstack sudo[84832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:03 devstack sudo[84832]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" returned: 0 in 0.758s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-quobyte-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24" released by "delete_volume" :: held 1.602s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG cinder.quota [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Created reservations ['7a635ac9-6383-4549-ab1b-f47b35aba1ff', 'e045c5cb-cb13-4d76-bd49-fc35d9df1d83', '15ca1126-5753-4851-af43-0517cddb5c30', '1e092723-8fc2-42c2-a374-dbc691a43f4b'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:03 devstack sudo[84841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:03 devstack sudo[84841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Creating offline snapshot b9891771-36f1-4edb-b54e-87759feb71cc of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[8068194e-22c8-42df-a079-15e947902281]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:03 devstack sudo[84846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:03 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:04 devstack sudo[84841]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.852s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:04 devstack cinder-volume[82690]: DEBUG cinder.manager [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:04 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Deleted volume successfully.
Apr 20 17:31:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-063812b2-c0d1-4b16-878e-f7752c7eccd1 req-4ecd6288-0a50-40df-9542-94ae62c3776d tempest-VolumesSnapshotsTestJSON-1299424136 None] Lock "cinder-4f4dc2d8-4a44-41c5-9179-2f2d5e215a24-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:04 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.815s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:04 devstack sudo[84858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc 1G
Apr 20 17:31:04 devstack sudo[84858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:04 devstack sudo[84858]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc 1G" returned: 0 in 0.689s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:04 devstack sudo[84863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc
Apr 20 17:31:04 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:05 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc" returned: 0 in 0.654s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:05 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc is being set with open permissions: ugo+rw
Apr 20 17:31:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:05 devstack sudo[84868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc
Apr 20 17:31:05 devstack sudo[84868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:06 devstack sudo[84868]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc" returned: 0 in 0.493s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.743s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:06 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a2e329b0-48aa-4845-a645-8a22d6074fdc tempest-SnapshotsActionsTest-1722502918 None] Create snapshot completed successfully
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-b9891771-36f1-4edb-b54e-87759feb71cc-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-b9891771-36f1-4edb-b54e-87759feb71cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-quobyte-b9891771-36f1-4edb-b54e-87759feb71cc" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-b9891771-36f1-4edb-b54e-87759feb71cc" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Deleting offline snapshot b9891771-36f1-4edb-b54e-87759feb71cc of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] snapshot_file for this snap is: volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[2102545f-1273-41dd-95a2-435a4bbf59ba]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:07 devstack sudo[84873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc
Apr 20 17:31:07 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:07 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-90e88974-6f92-4d04-9750-baeb25523584 tempest-GroupSnapshotsTest-1386276573 None] Group tempest-GroupSnapshotsTest-Group-1581035503: creating
Apr 20 17:31:07 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-90e88974-6f92-4d04-9750-baeb25523584 tempest-GroupSnapshotsTest-1386276573 None] Group tempest-GroupSnapshotsTest-Group-1581035503: created successfully
Apr 20 17:31:07 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-90e88974-6f92-4d04-9750-baeb25523584 tempest-GroupSnapshotsTest-1386276573 None] Create group completed successfully.
Apr 20 17:31:07 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc" returned: 0 in 1.057s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:07 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38affca-47f6-43d8-b7c2-10c728854c2c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:08 devstack sudo[84880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:08 devstack sudo[84880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:08 devstack sudo[84880]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.665s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:08 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc
Apr 20 17:31:08 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Flow 'volume_create_manager' (37fda544-7ea5-4930-ae82-452f46186375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fe2b7a-0b4a-4ea9-8bfa-f6c1f04d9567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Flow 'volume_create_manager' (4cdd948d-523c-41d2-bd86-492860081476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f068ff2f-56dc-4ef9-ac12-4918a525e336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fe2b7a-0b4a-4ea9-8bfa-f6c1f04d9567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1116777401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b21d12a-600f-4ddc-8091-626c8d23337e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eb8d754daf46b783a6f9a63587693c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:09Z,use_quota=True,user_id='f3cd63e8136d4486949a603971966ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bef513-2978-4b38-a1fa-5e6cbfa86cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bef513-2978-4b38-a1fa-5e6cbfa86cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0c25fa-97a4-4d1a-90e9-72e115540ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0c25fa-97a4-4d1a-90e9-72e115540ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b21d12a-600f-4ddc-8091-626c8d23337e', 'volume_name': 'volume-5b21d12a-600f-4ddc-8091-626c8d23337e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af4f88-5511-4bb5-9de5-3e33c1eabf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af4f88-5511-4bb5-9de5-3e33c1eabf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b7f6ec-98d5-44f0-9e69-a5420f5f7b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:08 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Volume 5b21d12a-600f-4ddc-8091-626c8d23337e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b21d12a-600f-4ddc-8091-626c8d23337e', 'volume_size': 1}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1116777401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b21d12a-600f-4ddc-8091-626c8d23337e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eb8d754daf46b783a6f9a63587693c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:09Z,use_quota=True,user_id='f3cd63e8136d4486949a603971966ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Creating volume 5b21d12a-600f-4ddc-8091-626c8d23337e {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:08 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f068ff2f-56dc-4ef9-ac12-4918a525e336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:08Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf507be0-70b5-409d-a346-6d48b481c443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76a010116944a12ae515bb6346c2e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:09Z,use_quota=True,user_id='c4f60c0df2694952a6570fc18cf46ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970b526d-838e-47e1-9d12-be44164b25e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970b526d-838e-47e1-9d12-be44164b25e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d8599f-9a9d-4e2e-bf25-249c2aefb1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:08 devstack cinder-volume[82690]: DEBUG cinder.image.glance [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Creating Keystone auth plugin from conf {{(pid=82690) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 17:31:08 devstack sudo[84907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e 1073741824
Apr 20 17:31:08 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Flow 'volume_create_manager' (c80d5712-82e0-4a27-bc46-1c34fe75aab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3c3ad6-d1a3-4367-b821-47b6a832450d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3c3ad6-d1a3-4367-b821-47b6a832450d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-580513457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b1384f0-4193-43fb-b740-355d56833d0f,host='devstack@QuobyteHD#QuobyteHD',id=076df196-c8d9-41cc-ab32-d8b3e873daa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d7085181644cfba5a4476f6e35122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:09Z,use_quota=True,user_id='b4271f90d7e240dc8c92cf129888ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(510224d6-5825-4403-8feb-e97b6865f84f),volume_type_id=510224d6-5825-4403-8feb-e97b6865f84f)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389cf1e7-c39f-4d78-a7ad-635d4bf03e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389cf1e7-c39f-4d78-a7ad-635d4bf03e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04584121-d4de-4c91-b14b-a57de72d7165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04584121-d4de-4c91-b14b-a57de72d7165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '076df196-c8d9-41cc-ab32-d8b3e873daa7', 'volume_name': 'volume-076df196-c8d9-41cc-ab32-d8b3e873daa7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074e803f-ceb4-4a06-b647-5bdb18dba7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074e803f-ceb4-4a06-b647-5bdb18dba7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7959a8-a51c-45e2-890e-0c39630f4648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:09 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Volume 076df196-c8d9-41cc-ab32-d8b3e873daa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-076df196-c8d9-41cc-ab32-d8b3e873daa7', 'volume_size': 1}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d8599f-9a9d-4e2e-bf25-249c2aefb1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf507be0-70b5-409d-a346-6d48b481c443', 'volume_name': 'volume-cf507be0-70b5-409d-a346-6d48b481c443', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91bf8d9c0>}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77414a6f-9e99-442d-bfca-88a4421ea074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77414a6f-9e99-442d-bfca-88a4421ea074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c42335-5008-48eb-8a15-c16d8b64f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:09 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Volume cf507be0-70b5-409d-a346-6d48b481c443: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf507be0-70b5-409d-a346-6d48b481c443', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91bf8d9c0>}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Trying to clone cf507be0-70b5-409d-a346-6d48b481c443 from image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]). {{(pid=82690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 17:31:09 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc" returned: 0 in 0.903s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:09 devstack sudo[84935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc
Apr 20 17:31:09 devstack sudo[84935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 17:31:09 devstack cinder-volume[82690]: INFO cinder.image.image_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 17:31:09 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e 1073741824" returned: 0 in 0.899s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc290015-e2ed-4f0d-af01-3e77bcbb6063]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:09 devstack sudo[84939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e
Apr 20 17:31:09 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:09 devstack sudo[84938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD
Apr 20 17:31:09 devstack sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:10 devstack sudo[84935]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.b9891771-36f1-4edb-b54e-87759feb71cc" returned: 0 in 0.516s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-b9891771-36f1-4edb-b54e-87759feb71cc" released by "_delete_snapshot" :: held 3.203s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" released by "delete_snapshot" :: held 3.247s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Created reservations ['529f986a-7eb0-4548-bc07-7fa4df1e8d0f', 'ac0aabd3-515f-4aa4-ba0f-acde0f314591', '573985c3-0c86-4b84-bb94-4fcbc74f4573', '135aa412-f25d-4366-ba42-5df6d2265367'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Delete snapshot completed successfully.
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-332c461e-3ce6-4429-aa66-a16310be0e36 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-b9891771-36f1-4edb-b54e-87759feb71cc-delete_snapshot" released by "delete_snapshot" :: held 3.345s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:10 devstack sudo[84938]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Temporary image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e is fetched for user c4f60c0df2694952a6570fc18cf46ace. {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 17:31:10 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e" returned: 0 in 0.505s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0b1384f0-4193-43fb-b740-355d56833d0f,created_at=2026-04-20T15:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-580513457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b1384f0-4193-43fb-b740-355d56833d0f,host='devstack@QuobyteHD#QuobyteHD',id=076df196-c8d9-41cc-ab32-d8b3e873daa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d7085181644cfba5a4476f6e35122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:09Z,use_quota=True,user_id='b4271f90d7e240dc8c92cf129888ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(510224d6-5825-4403-8feb-e97b6865f84f),volume_type_id=510224d6-5825-4403-8feb-e97b6865f84f)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Creating volume 076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:10 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:10 devstack sudo[84947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 1073741824
Apr 20 17:31:10 devstack sudo[84947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b7f6ec-98d5-44f0-9e69-a5420f5f7b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b21d12a-600f-4ddc-8091-626c8d23337e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1e8d26-d6e7-4079-8745-4174e691a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fcbb38-42eb-4cf1-9369-5a075fcdeaf9]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:10 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Volume volume-5b21d12a-600f-4ddc-8091-626c8d23337e (5b21d12a-600f-4ddc-8091-626c8d23337e): created successfully
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1e8d26-d6e7-4079-8745-4174e691a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Flow 'volume_create_manager' (37fda544-7ea5-4930-ae82-452f46186375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e2615845-c5ce-4e03-8a01-bb4c77686f37 tempest-VolumeQuotasAdminTestJSON-222697102 None] Created volume successfully.
Apr 20 17:31:10 devstack sudo[84949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD
Apr 20 17:31:10 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Acquiring lock "cinder-5b21d12a-600f-4ddc-8091-626c8d23337e-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "cinder-5b21d12a-600f-4ddc-8091-626c8d23337e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Acquiring lock "cinder-quobyte-5b21d12a-600f-4ddc-8091-626c8d23337e" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "cinder-quobyte-5b21d12a-600f-4ddc-8091-626c8d23337e" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0b0200-d624-4736-9d70-4e9e15cbfddc]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:10 devstack sudo[84947]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 1073741824" returned: 0 in 0.605s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:10 devstack sudo[84955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7
Apr 20 17:31:10 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:10 devstack sudo[84954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e
Apr 20 17:31:10 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:11 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD" returned: 0 in 0.711s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:11 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e" returned: 0 in 0.544s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:11 devstack sudo[84965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e
Apr 20 17:31:11 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:11 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7" returned: 0 in 0.548s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:08Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf507be0-70b5-409d-a346-6d48b481c443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76a010116944a12ae515bb6346c2e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:09Z,use_quota=True,user_id='c4f60c0df2694952a6570fc18cf46ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Creating volume cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:11 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7959a8-a51c-45e2-890e-0c39630f4648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076df196-c8d9-41cc-ab32-d8b3e873daa7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:11 devstack sudo[84971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 1073741824
Apr 20 17:31:11 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7807dfa9-95e4-4c12-ad49-44a10c2d9a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:11 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Volume volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 (076df196-c8d9-41cc-ab32-d8b3e873daa7): created successfully
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7807dfa9-95e4-4c12-ad49-44a10c2d9a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Flow 'volume_create_manager' (c80d5712-82e0-4a27-bc46-1c34fe75aab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:11 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0c16759f-f175-471a-9174-eb26dbcad5c0 tempest-GroupSnapshotsTest-1386276573 None] Created volume successfully.
Apr 20 17:31:11 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b21d12a-600f-4ddc-8091-626c8d23337e" returned: 0 in 0.487s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "cinder-quobyte-5b21d12a-600f-4ddc-8091-626c8d23337e" released by "delete_volume" :: held 1.061s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:11 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Created reservations ['a95a0dab-6031-4e2f-817c-3b77fcbbf3c3', '0c45c4c9-9318-45c6-a622-a50d3e643e73', '17edecc0-e02f-4c35-8ebc-cc8d15cc9291', 'ed058b62-f326-49c2-a6be-0174a259b342'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:12 devstack sudo[84981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:12 devstack sudo[84981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:12 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 1073741824" returned: 0 in 0.589s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:12 devstack sudo[84983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443
Apr 20 17:31:12 devstack sudo[84983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:12 devstack sudo[84981]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.505s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Deleted volume successfully.
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ee75c1e1-6b56-499f-8d36-b797da7d1ef8 tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "cinder-5b21d12a-600f-4ddc-8091-626c8d23337e-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:12 devstack sudo[84983]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443" returned: 0 in 0.479s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.217s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Creating offline snapshot ca9542fe-0db5-4130-9785-22f9706c2d6f of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Attempting download of 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}])) to volume cf507be0-70b5-409d-a346-6d48b481c443. {{(pid=82690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd07fc2-1fab-4f80-bf9f-30c016f3c50d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10d2458-178f-4582-bdf2-df7134609bf2]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_oolk7b07 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] GroupSnapshot 5eeb00f6-2122-4357-8abf-ca2e97fd763b: creating.
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Group snapshot 5eeb00f6-2122-4357-8abf-ca2e97fd763b: creating. {{(pid=82690) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 17:31:12 devstack sudo[84987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:12 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:12 devstack sudo[84988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_oolk7b07
Apr 20 17:31:12 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:13 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.586s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:13 devstack sudo[85022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f 1G
Apr 20 17:31:13 devstack sudo[85022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:13 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_oolk7b07" returned: 0 in 0.714s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_oolk7b07 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Flow 'volume_create_manager' (255856b8-2384-4fb3-9c93-edf7bdca1457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddd5c8e-34c8-43a9-85d6-092497561caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddd5c8e-34c8-43a9-85d6-092497561caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-235434654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faad83d3-d29f-4cc8-8f53-6c2403b8afb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eb8d754daf46b783a6f9a63587693c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:13Z,use_quota=True,user_id='f3cd63e8136d4486949a603971966ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bd93b3-5fb4-40e4-8765-b705cba3b8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bd93b3-5fb4-40e4-8765-b705cba3b8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e42035-a874-4712-a70e-4a9a14bb4259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e42035-a874-4712-a70e-4a9a14bb4259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faad83d3-d29f-4cc8-8f53-6c2403b8afb7', 'volume_name': 'volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0d5f45-2d2f-4021-a259-b972f8c2c2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0d5f45-2d2f-4021-a259-b972f8c2c2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3716e6-220c-4135-887f-37d1351cd017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:13 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Volume faad83d3-d29f-4cc8-8f53-6c2403b8afb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7', 'volume_size': 1}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:13 devstack sudo[85024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_oolk7b07
Apr 20 17:31:13 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:13 devstack sudo[85022]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f 1G" returned: 0 in 0.600s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:13 devstack sudo[85031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f
Apr 20 17:31:13 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:13 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_oolk7b07" returned: 1 in 0.517s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_oolk7b07' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0716a6f6-ab6c-4898-93eb-0edee83f9778]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:13 devstack sudo[85033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD
Apr 20 17:31:13 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:14 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f" returned: 0 in 0.452s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:14 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f is being set with open permissions: ugo+rw
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:14 devstack sudo[85038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f
Apr 20 17:31:14 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:14 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e was qcow2, converting to raw {{(pid=82690) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:14 devstack sudo[85043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443
Apr 20 17:31:14 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:14 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f" returned: 0 in 0.453s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.058s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:14 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-89384f8a-78c9-4a80-9430-6507c1d55e8f tempest-SnapshotsActionsTest-1722502918 None] Create snapshot completed successfully
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Creating offline snapshot 3b2f810a-3b8d-43b5-b36a-33ad6e717167 of volume 076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc729c-3e19-4e48-bbb3-71ce4f8351f6]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:14 devstack sudo[85050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7
Apr 20 17:31:14 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:15 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443" returned: 0 in 0.917s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_4nj0z_n2devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:31:15 devstack cinder-volume[82690]: INFO cinder.image.image_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Converted 112.00 MB image at 112.00 MB/s
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:15 devstack sudo[85064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 1G
Apr 20 17:31:15 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:15 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7" returned: 0 in 0.602s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:15 devstack sudo[85066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 1G
Apr 20 17:31:15 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-ca9542fe-0db5-4130-9785-22f9706c2d6f-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-ca9542fe-0db5-4130-9785-22f9706c2d6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-quobyte-ca9542fe-0db5-4130-9785-22f9706c2d6f" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-ca9542fe-0db5-4130-9785-22f9706c2d6f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Deleting offline snapshot ca9542fe-0db5-4130-9785-22f9706c2d6f of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] snapshot_file for this snap is: volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a4f1c9-0369-474d-90f1-3a0fa0c66699]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:15 devstack sudo[85068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f
Apr 20 17:31:15 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:15 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 1G" returned: 0 in 0.579s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb596c-d148-4244-90e1-7968ae7f1af5]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:16 devstack sudo[85077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443
Apr 20 17:31:16 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:16 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 1G" returned: 0 in 0.653s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:16 devstack sudo[85079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167
Apr 20 17:31:16 devstack sudo[85079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:16 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f" returned: 0 in 0.528s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[db085bfb-e74d-4beb-b7d8-1a75473ed3a3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:16 devstack sudo[85084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:16 devstack sudo[85084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:16 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443" returned: 0 in 0.558s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:16 devstack sudo[85079]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167" returned: 0 in 0.498s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:16 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:16 devstack sudo[85091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443
Apr 20 17:31:16 devstack sudo[85091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:16 devstack sudo[85093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167
Apr 20 17:31:16 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:16 devstack sudo[85084]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.532s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:16 devstack sudo[85098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f
Apr 20 17:31:16 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:17 devstack sudo[85091]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443" returned: 1 in 0.560s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Downloaded image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}])) to volume cf507be0-70b5-409d-a346-6d48b481c443 successfully. {{(pid=82690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Temporary image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e for user c4f60c0df2694952a6570fc18cf46ace is deleted. {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Marking volume cf507be0-70b5-409d-a346-6d48b481c443 as bootable. {{(pid=82690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Copying metadata from image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e to cf507be0-70b5-409d-a346-6d48b481c443. {{(pid=82690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Creating volume glance metadata for volume cf507be0-70b5-409d-a346-6d48b481c443 backed by image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c42335-5008-48eb-8a15-c16d8b64f31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf507be0-70b5-409d-a346-6d48b481c443', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91bf8d9c0>}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242b312b-ea68-4358-8b3d-aac6535df55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:17 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Volume volume-cf507be0-70b5-409d-a346-6d48b481c443 (cf507be0-70b5-409d-a346-6d48b481c443): created successfully
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242b312b-ea68-4358-8b3d-aac6535df55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Flow 'volume_create_manager' (4cdd948d-523c-41d2-bd86-492860081476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:17 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-a3293c2f-a7a2-4564-a508-e0dd2ef0d422 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Created volume successfully.
Apr 20 17:31:17 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167" returned: 0 in 0.607s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:17 devstack sudo[85106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.info
Apr 20 17:31:17 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:17 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f" returned: 0 in 0.553s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:17 devstack sudo[85109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f
Apr 20 17:31:17 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:17 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.info" returned: 0 in 0.459s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:17 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:17 devstack sudo[85112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.info
Apr 20 17:31:17 devstack sudo[85112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:17 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.ca9542fe-0db5-4130-9785-22f9706c2d6f" returned: 0 in 0.432s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-ca9542fe-0db5-4130-9785-22f9706c2d6f" released by "_delete_snapshot" :: held 2.115s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" released by "delete_snapshot" :: held 2.130s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Created reservations ['04b3de4d-c3ae-4646-8090-7c6d462e9f49', 'ff713236-4eb6-4be1-8742-b98b80620b5a', '3e4fef1a-0df4-4017-b6b4-89483ab71046', 'eda60cc3-2739-4688-b07e-a5f367f45c26'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:17 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Delete snapshot completed successfully.
Apr 20 17:31:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ff3a9d00-e5b7-414f-817a-30258c0a56b9 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-ca9542fe-0db5-4130-9785-22f9706c2d6f-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:18 devstack sudo[85112]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.info" returned: 0 in 0.485s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.379s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.686s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-235434654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faad83d3-d29f-4cc8-8f53-6c2403b8afb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eb8d754daf46b783a6f9a63587693c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:13Z,use_quota=True,user_id='f3cd63e8136d4486949a603971966ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Creating volume faad83d3-d29f-4cc8-8f53-6c2403b8afb7 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:18 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:18 devstack sudo[85124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7 1073741824
Apr 20 17:31:18 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:18 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-583081b5-7fcf-4191-bda4-0b8abda1350f tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 5eeb00f6-2122-4357-8abf-ca2e97fd763b: created successfully
Apr 20 17:31:18 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7 1073741824" returned: 0 in 0.526s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:18 devstack sudo[85129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7
Apr 20 17:31:18 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:19 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7" returned: 0 in 0.540s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.123s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3716e6-220c-4135-887f-37d1351cd017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc42a70-9d6f-4241-ba3b-fff588a80117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a48925-b5d4-4426-affa-e08ea2daaccd]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:19 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Volume volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7 (faad83d3-d29f-4cc8-8f53-6c2403b8afb7): created successfully
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc42a70-9d6f-4241-ba3b-fff588a80117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Flow 'volume_create_manager' (255856b8-2384-4fb3-9c93-edf7bdca1457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:19 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7f0cdfa1-8dae-4fa8-8e0a-34c6b6a306ce tempest-VolumeQuotasAdminTestJSON-222697102 None] Created volume successfully.
Apr 20 17:31:19 devstack sudo[85132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443
Apr 20 17:31:19 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:19 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443" returned: 0 in 0.511s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:19 devstack sudo[85136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443
Apr 20 17:31:19 devstack sudo[85136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:20 devstack sudo[85136]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443" returned: 1 in 0.499s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.312s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a', 'name': 'volume-cf507be0-70b5-409d-a346-6d48b481c443', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71c99c80-5db4-48e4-b477-eca677d74772', 'enforce_multipath': True} {{(pid=82690) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Creating offline snapshot 957059df-9070-4a2f-9753-5321531da299 of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[181867b9-c317-4cc5-bb89-2cb3dc46847b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:20 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-a3bf5f2c-3ff1-42fb-9dc5-75f857b95fe5 req-74df9f91-da6d-4130-9469-4decfe41ff80 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] attachment_update completed successfully.
Apr 20 17:31:20 devstack sudo[85141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:20 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:20 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c6231c16-ef07-4f90-862a-ada77eb2c634 tempest-VolumeQuotasAdminTestJSON-1373774347 None] Transfer volume completed successfully.
Apr 20 17:31:20 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.514s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:20 devstack sudo[85146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 1G
Apr 20 17:31:20 devstack sudo[85146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Acquiring lock "cinder-faad83d3-d29f-4cc8-8f53-6c2403b8afb7-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Lock "cinder-faad83d3-d29f-4cc8-8f53-6c2403b8afb7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Acquiring lock "cinder-quobyte-faad83d3-d29f-4cc8-8f53-6c2403b8afb7" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Lock "cinder-quobyte-faad83d3-d29f-4cc8-8f53-6c2403b8afb7" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f41b574-69d2-44dc-9607-e98b5b5edb54]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:21 devstack sudo[85151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7
Apr 20 17:31:21 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:21 devstack sudo[85146]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 1G" returned: 0 in 0.570s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:21 devstack sudo[85153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299
Apr 20 17:31:21 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:21 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299" returned: 0 in 0.475s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:21 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 is being set with open permissions: ugo+rw
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:21 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7" returned: 0 in 0.578s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:21 devstack sudo[85161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299
Apr 20 17:31:21 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:21 devstack sudo[85162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7
Apr 20 17:31:21 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:22 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299" returned: 0 in 0.433s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.455s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-3b2f810a-3b8d-43b5-b36a-33ad6e717167-40f70eb0-8e09-4274-8aa9-9b9957e024fa" by "_create_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-2f20d034-a04c-4d71-bfbd-ac32c42aed7a tempest-SnapshotsActionsTest-1722502918 None] Create snapshot completed successfully
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-3b2f810a-3b8d-43b5-b36a-33ad6e717167-40f70eb0-8e09-4274-8aa9-9b9957e024fa" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Creating volume 40f70eb0-8e09-4274-8aa9-9b9957e024fa from snapshot 3b2f810a-3b8d-43b5-b36a-33ad6e717167 {{(pid=82690) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:22 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-40f70eb0-8e09-4274-8aa9-9b9957e024fa" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-faad83d3-d29f-4cc8-8f53-6c2403b8afb7" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Lock "cinder-quobyte-faad83d3-d29f-4cc8-8f53-6c2403b8afb7" released by "delete_volume" :: held 1.095s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-40f70eb0-8e09-4274-8aa9-9b9957e024fa" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] snapshot: 3b2f810a-3b8d-43b5-b36a-33ad6e717167, volume: 40f70eb0-8e09-4274-8aa9-9b9957e024fa,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6d46a9-28e3-4660-b9a7-5161ed9ec8e6]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Created reservations ['23f40e63-f039-49de-83ae-b58ec69f8dfc', 'd175af97-bb2b-442a-a1e3-47e82a114afb', '769b2b9b-2b12-4d9c-88cb-3b717bd63716', 'b9cd26c0-b61c-4639-911b-7479318fdfcb'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:22 devstack sudo[85167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167
Apr 20 17:31:22 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:22 devstack sudo[85168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:22 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:22 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.424s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:22 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Deleted volume successfully.
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167" returned: 0 in 0.501s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-076df196-c8d9-41cc-ab32-d8b3e873daa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5703a0b5-b12f-47b0-9799-4593e87ca218]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5e63cb84-d134-49e5-964b-6e846db406c4 tempest-VolumeQuotasAdminTestJSON-297397907 None] Lock "cinder-faad83d3-d29f-4cc8-8f53-6c2403b8afb7-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:23 devstack sudo[85175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7
Apr 20 17:31:23 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-957059df-9070-4a2f-9753-5321531da299-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-957059df-9070-4a2f-9753-5321531da299-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-quobyte-957059df-9070-4a2f-9753-5321531da299" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-957059df-9070-4a2f-9753-5321531da299" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Deleting offline snapshot 957059df-9070-4a2f-9753-5321531da299 of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] snapshot_file for this snap is: volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[26449233-5b9c-4cfc-979f-af63b28520ff]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:23 devstack sudo[85180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299
Apr 20 17:31:23 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:23 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7" returned: 0 in 0.571s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:23 devstack sudo[85185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa
Apr 20 17:31:23 devstack sudo[85185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:23 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299" returned: 0 in 0.540s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[77866539-54fd-4c0d-ba44-a7c10572fa03]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:24 devstack sudo[85190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:24 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:25 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 1.476s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:25 devstack sudo[85234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299
Apr 20 17:31:25 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:26 devstack sudo[85185]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa" returned: 0 in 3.370s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:26 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cf873f-0f00-4646-99aa-88fbcc2953f6]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:27 devstack sudo[85243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7
Apr 20 17:31:27 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:27 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299" returned: 0 in 1.756s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:27 devstack sudo[85246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299
Apr 20 17:31:27 devstack sudo[85246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:27 devstack sudo[85246]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.957059df-9070-4a2f-9753-5321531da299" returned: 0 in 0.514s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-957059df-9070-4a2f-9753-5321531da299" released by "_delete_snapshot" :: held 4.369s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" released by "delete_snapshot" :: held 4.419s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Created reservations ['e8b651e8-981c-4284-8af6-bbe658c5fbef', 'fcd83b99-1c06-423d-b4da-b20f36d4a1b2', 'f443bf21-6195-4f39-ac76-387d7e993d7c', 'a5479bbc-6bdb-42b5-85e5-6cdc8dcb8cd4'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:27 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Delete snapshot completed successfully.
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06d7a100-2874-48ca-af0b-a071e1d2f974 tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-957059df-9070-4a2f-9753-5321531da299-delete_snapshot" released by "delete_snapshot" :: held 4.534s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:27 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7" returned: 0 in 0.956s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7, size 1024.00 MB, duration 3.37 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:31:27 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Converted 1024.00 MB image at 303.71 MB/s
Apr 20 17:31:27 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:31:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:27 devstack sudo[85253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa
Apr 20 17:31:27 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:28 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa" returned: 0 in 0.561s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-40f70eb0-8e09-4274-8aa9-9b9957e024fa" released by "_copy_volume_from_snapshot" :: held 6.023s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-3b2f810a-3b8d-43b5-b36a-33ad6e717167-40f70eb0-8e09-4274-8aa9-9b9957e024fa" released by "_create_volume_from_snapshot" :: held 6.049s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.080s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:28 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8b32acf6-ad57-4aa1-9552-f67ee6e44e2b tempest-GroupSnapshotsTest-1386276573 None] Create group from source-snapshot-5eeb00f6-2122-4357-8abf-ca2e97fd763b completed successfully.
Apr 20 17:31:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Creating offline snapshot 9307cb95-bf70-49e4-8259-c3a0812a25f4 of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:31:29 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d76e37-5d58-4ac9-824b-fe911691b1f4]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:29 devstack sudo[85256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:29 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-40f70eb0-8e09-4274-8aa9-9b9957e024fa" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-40f70eb0-8e09-4274-8aa9-9b9957e024fa" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:29 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[093ebf85-9349-4fed-ad6a-1db06ea4c074]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:29 devstack sudo[85259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa
Apr 20 17:31:29 devstack sudo[85259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:30 devstack sudo[85259]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa" returned: 0 in 0.704s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:30 devstack sudo[85267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa
Apr 20 17:31:30 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:30 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 1.197s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:30 devstack sudo[85269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 1G
Apr 20 17:31:30 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:31 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-40f70eb0-8e09-4274-8aa9-9b9957e024fa" returned: 0 in 0.774s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-40f70eb0-8e09-4274-8aa9-9b9957e024fa" released by "delete_volume" :: held 1.517s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:31 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 1G" returned: 0 in 0.683s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['e3803b0a-2e5f-4198-9fdd-a74c8a485a38'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:31 devstack sudo[85275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4
Apr 20 17:31:31 devstack sudo[85275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:31 devstack cinder-volume[82690]: WARNING cinder.quota [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1652638945 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1652638945, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:31:31 devstack cinder-volume[82690]: WARNING cinder.quota [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1652638945 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1652638945, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['6dfa00de-adfb-492b-bb81-13fdb2a2b43e', '0fb13e45-3034-4ad5-97ea-fdfe0ba9e286', '37a138eb-3ef9-469f-b61e-18d3d106da01', '9d271e4a-d931-49f8-81f2-dd390a765abb'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:31 devstack sudo[85277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:31 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Flow 'volume_create_manager' (f9bfb6ed-b413-49b9-aee9-808ed9b4a746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6863946-7157-4466-9862-673a6ece4863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6863946-7157-4466-9862-673a6ece4863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1045353940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f00af5-3f60-4df6-b115-bbd739341cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2a97f1bc9e41e883d3eac042305592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:31Z,use_quota=True,user_id='dcb1be4257904f6cb3b0c8ec3a68adcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db206402-4789-4490-9511-7831fa11f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db206402-4789-4490-9511-7831fa11f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba114109-962f-4353-bfee-9faac4393c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba114109-962f-4353-bfee-9faac4393c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3f00af5-3f60-4df6-b115-bbd739341cac', 'volume_name': 'volume-b3f00af5-3f60-4df6-b115-bbd739341cac', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abcbdfb-584d-4728-b954-7f1d918f6d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8abcbdfb-584d-4728-b954-7f1d918f6d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87432651-458d-4bdf-8f09-0175dcd6c72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:31 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Volume b3f00af5-3f60-4df6-b115-bbd739341cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3f00af5-3f60-4df6-b115-bbd739341cac', 'volume_size': 1}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:31 devstack sudo[85275]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4" returned: 0 in 0.534s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:31 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 is being set with open permissions: ugo+rw
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:31 devstack sudo[85282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4
Apr 20 17:31:31 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:31 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.502s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:31 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b26eb7d7-e969-41ea-a8e2-744496b115f1 tempest-GroupSnapshotsTest-1386276573 None] Delete group completed successfully.
Apr 20 17:31:31 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 5eeb00f6-2122-4357-8abf-ca2e97fd763b: deleting
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 5eeb00f6-2122-4357-8abf-ca2e97fd763b: deleting {{(pid=82690) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-076df196-c8d9-41cc-ab32-d8b3e873daa7" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-076df196-c8d9-41cc-ab32-d8b3e873daa7" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-3b2f810a-3b8d-43b5-b36a-33ad6e717167" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-3b2f810a-3b8d-43b5-b36a-33ad6e717167" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Deleting offline snapshot 3b2f810a-3b8d-43b5-b36a-33ad6e717167 of volume 076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:31:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] snapshot_file for this snap is: volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fcf43b-6f18-4653-9477-11991272f352]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:32 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4" returned: 0 in 0.456s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:32 devstack sudo[85286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167
Apr 20 17:31:32 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.101s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1045353940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3f00af5-3f60-4df6-b115-bbd739341cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a2a97f1bc9e41e883d3eac042305592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:31Z,use_quota=True,user_id='dcb1be4257904f6cb3b0c8ec3a68adcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Creating volume b3f00af5-3f60-4df6-b115-bbd739341cac {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:32 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:32 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a2ba7e4c-1709-447a-8277-f9a1f91da959 tempest-SnapshotsActionsTest-1722502918 None] Create snapshot completed successfully
Apr 20 17:31:32 devstack sudo[85288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac 1073741824
Apr 20 17:31:32 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:32 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167" returned: 0 in 0.557s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-076df196-c8d9-41cc-ab32-d8b3e873daa7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c7e3dd-cefa-4505-b488-af007805c6df]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:32 devstack sudo[85296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7
Apr 20 17:31:32 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:32 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac 1073741824" returned: 0 in 0.547s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:32 devstack sudo[85298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac
Apr 20 17:31:32 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:33 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7" returned: 0 in 0.487s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:33 devstack sudo[85304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167
Apr 20 17:31:33 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:33 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac" returned: 0 in 0.444s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87432651-458d-4bdf-8f09-0175dcd6c72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3f00af5-3f60-4df6-b115-bbd739341cac', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0d39dc-e5d8-4199-abf8-51ccef29a263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:33 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Volume volume-b3f00af5-3f60-4df6-b115-bbd739341cac (b3f00af5-3f60-4df6-b115-bbd739341cac): created successfully
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0d39dc-e5d8-4199-abf8-51ccef29a263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Flow 'volume_create_manager' (f9bfb6ed-b413-49b9-aee9-808ed9b4a746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:33 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3a010d40-c5d2-4210-9cea-675c2655649d tempest-VolumeQuotasNegativeTestJSON-984335823 None] Created volume successfully.
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-9307cb95-bf70-49e4-8259-c3a0812a25f4-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-9307cb95-bf70-49e4-8259-c3a0812a25f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Acquiring lock "cinder-quobyte-9307cb95-bf70-49e4-8259-c3a0812a25f4" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-9307cb95-bf70-49e4-8259-c3a0812a25f4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Deleting offline snapshot 9307cb95-bf70-49e4-8259-c3a0812a25f4 of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] snapshot_file for this snap is: volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[242c0fa3-3079-4814-9d79-855d8ed9d217]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:33 devstack sudo[85330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4
Apr 20 17:31:33 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:33 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167" returned: 0 in 0.563s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:33 devstack sudo[85335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167
Apr 20 17:31:33 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:34 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4" returned: 0 in 0.573s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c5813c-4272-4d44-bb54-9ee9996e61df]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:34 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:34 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:34 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7.3b2f810a-3b8d-43b5-b36a-33ad6e717167" returned: 0 in 0.543s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-3b2f810a-3b8d-43b5-b36a-33ad6e717167" released by "_delete_snapshot" :: held 2.197s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-076df196-c8d9-41cc-ab32-d8b3e873daa7" released by "delete_snapshot" :: held 2.214s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:34 devstack cinder-volume[82690]: WARNING cinder.quota [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1652638945 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1652638945, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['842f0427-e0f6-4c86-826c-e6f898ace7c1', '4aa98351-59a8-4846-b825-7e00db64472e', '90f7d97c-9c7b-48d9-a2b9-91e48304207f', '3d532454-cc6b-4794-80a3-cdcf37e7f92f'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Acquiring lock "cinder-b3f00af5-3f60-4df6-b115-bbd739341cac-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:34 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-aaff8227-5037-484f-95a6-9e9e41f9c3e3 tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 5eeb00f6-2122-4357-8abf-ca2e97fd763b: deleted successfully
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "cinder-b3f00af5-3f60-4df6-b115-bbd739341cac-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Acquiring lock "cinder-quobyte-b3f00af5-3f60-4df6-b115-bbd739341cac" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "cinder-quobyte-b3f00af5-3f60-4df6-b115-bbd739341cac" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef1bb6b-811b-4956-8ef0-d2c16eece597]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:34 devstack sudo[85344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac
Apr 20 17:31:34 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:34 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.525s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:34 devstack sudo[85349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4
Apr 20 17:31:34 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:34 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac" returned: 0 in 0.551s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:34 devstack sudo[85363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac
Apr 20 17:31:34 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:35 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4" returned: 0 in 0.538s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:35 devstack sudo[85372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4
Apr 20 17:31:35 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:35 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b3f00af5-3f60-4df6-b115-bbd739341cac" returned: 0 in 0.443s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "cinder-quobyte-b3f00af5-3f60-4df6-b115-bbd739341cac" released by "delete_volume" :: held 1.020s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Created reservations ['77d7d822-f20d-49b5-bf73-0dc7cd188b38', '3ad0b0d6-dc0b-45e6-9626-997f1244592c', '1fb5a234-2c97-42d9-87ea-0418f9366e5f', '550007da-6a03-4016-b6a5-00581d95c0aa'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-076df196-c8d9-41cc-ab32-d8b3e873daa7" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-076df196-c8d9-41cc-ab32-d8b3e873daa7" acquired by "delete_volume" :: waited 0.041s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:35 devstack sudo[85382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:35 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbee0e5e-9c71-48c8-82be-5c906ce743ae]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:35 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.9307cb95-bf70-49e4-8259-c3a0812a25f4" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-9307cb95-bf70-49e4-8259-c3a0812a25f4" released by "_delete_snapshot" :: held 2.167s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" released by "delete_snapshot" :: held 2.185s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:35 devstack sudo[85384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7
Apr 20 17:31:35 devstack sudo[85384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Created reservations ['cdb70b09-c931-457b-ba13-ac0d45c12dc5', 'd3038813-7086-4652-bdbf-fe0067bb357e', 'fc3796dd-6502-4946-aab0-c2cdca92db0c', '60798b14-a40e-4cd4-8c35-780e967ae96b'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Delete snapshot completed successfully.
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3e6e59d9-14ea-4010-a2f3-e28f8bfa1f6a tempest-SnapshotsActionsTest-764183927 None] Lock "cinder-9307cb95-bf70-49e4-8259-c3a0812a25f4-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:35 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.426s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Deleted volume successfully.
Apr 20 17:31:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7a00ee9f-9fdb-4be3-bc95-053e4b504d7f tempest-VolumeQuotasNegativeTestJSON-984335823 None] Lock "cinder-b3f00af5-3f60-4df6-b115-bbd739341cac-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:36 devstack sudo[85384]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7" returned: 0 in 0.500s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:36 devstack sudo[85391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7
Apr 20 17:31:36 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:36 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-076df196-c8d9-41cc-ab32-d8b3e873daa7" returned: 0 in 0.439s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-076df196-c8d9-41cc-ab32-d8b3e873daa7" released by "delete_volume" :: held 0.966s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['2bdd8f86-6062-4bad-86aa-f056cc49600c'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:36 devstack cinder-volume[82690]: WARNING cinder.db.sqlalchemy.api [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1652638945']
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['882de1b8-5642-430f-ac7e-dd73539b4fed', 'dda84106-fe19-4dfe-aae7-f2f060fdd01c', '4f5cf31c-7a54-4ac5-9a2f-2980df4b7d6b', '9735cf8b-8de1-4324-8ccb-58791be1d572'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:36 devstack sudo[85394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:36 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "cinder-7e405b1c-8c08-4f28-95d7-022d1b9d8212-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-7e405b1c-8c08-4f28-95d7-022d1b9d8212-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "cinder-quobyte-7e405b1c-8c08-4f28-95d7-022d1b9d8212" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-quobyte-7e405b1c-8c08-4f28-95d7-022d1b9d8212" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Deleting offline snapshot 7e405b1c-8c08-4f28-95d7-022d1b9d8212 of volume 84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] snapshot_file for this snap is: volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c1727d-d559-4eca-aba9-8a337e7c87ec]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:37 devstack sudo[85396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:37 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:37 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.510s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:37 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7d16b7e9-a90b-4747-a1e4-90eb24810fdf tempest-GroupSnapshotsTest-1386276573 None] Delete group completed successfully.
Apr 20 17:31:37 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.534s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84727056-cadf-4e6b-b277-cccbc22dff42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:37 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[61012da3-b432-4b45-9f4f-3fa40acf0930]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:37 devstack sudo[85402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42
Apr 20 17:31:37 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7fb9b35f-1012-424a-8345-b41b02adf6b7 tempest-GroupSnapshotsTest-1386276573 None] Group tempest-GroupSnapshotsTest-Group-1998948971: creating
Apr 20 17:31:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7fb9b35f-1012-424a-8345-b41b02adf6b7 tempest-GroupSnapshotsTest-1386276573 None] Group tempest-GroupSnapshotsTest-Group-1998948971: created successfully
Apr 20 17:31:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7fb9b35f-1012-424a-8345-b41b02adf6b7 tempest-GroupSnapshotsTest-1386276573 None] Create group completed successfully.
Apr 20 17:31:38 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42" returned: 0 in 0.622s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:38 devstack sudo[85408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:38 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:38 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.558s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:38 devstack sudo[85413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212
Apr 20 17:31:38 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:39 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42.7e405b1c-8c08-4f28-95d7-022d1b9d8212" returned: 0 in 0.446s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-quobyte-7e405b1c-8c08-4f28-95d7-022d1b9d8212" released by "_delete_snapshot" :: held 2.244s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" released by "delete_snapshot" :: held 2.256s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Created reservations ['113fedd9-8a0a-4f31-abc8-4693c737c77a', '364f6823-2715-4a81-9253-746e336f6906', '56f4942c-9e8d-4342-b7ae-aabf2047b25b', '3ba0c051-713e-4ef4-996a-5b953ccdaad2'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Flow 'volume_create_manager' (788676b2-4d2c-4d80-abbf-516b8cce4430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3aeb92-e6de-4a04-a898-52eb161471da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3aeb92-e6de-4a04-a898-52eb161471da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1424635800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e1dbde4d-e2e8-44db-b86a-9b14634e199e,host='devstack@QuobyteHD#QuobyteHD',id=76c1d57b-1307-4e34-a18e-46adeeb6f9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d7085181644cfba5a4476f6e35122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:39Z,use_quota=True,user_id='b4271f90d7e240dc8c92cf129888ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e23464-e630-4984-b5aa-187b6977ca10),volume_type_id=a3e23464-e630-4984-b5aa-187b6977ca10)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0c202a-93ef-4a94-b2b4-8bca458aa0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0c202a-93ef-4a94-b2b4-8bca458aa0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b802af4-287b-440e-9cfa-38a2003e9867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b802af4-287b-440e-9cfa-38a2003e9867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c1d57b-1307-4e34-a18e-46adeeb6f9f2', 'volume_name': 'volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313d472c-cc09-4cb8-a32e-8a128c2b0eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313d472c-cc09-4cb8-a32e-8a128c2b0eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbae47c-5277-4a62-9cdc-14671b3e1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:39 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Volume 76c1d57b-1307-4e34-a18e-46adeeb6f9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2', 'volume_size': 1}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e1dbde4d-e2e8-44db-b86a-9b14634e199e,created_at=2026-04-20T15:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1424635800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e1dbde4d-e2e8-44db-b86a-9b14634e199e,host='devstack@QuobyteHD#QuobyteHD',id=76c1d57b-1307-4e34-a18e-46adeeb6f9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d7085181644cfba5a4476f6e35122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:39Z,use_quota=True,user_id='b4271f90d7e240dc8c92cf129888ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e23464-e630-4984-b5aa-187b6977ca10),volume_type_id=a3e23464-e630-4984-b5aa-187b6977ca10)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Creating volume 76c1d57b-1307-4e34-a18e-46adeeb6f9f2 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:39 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:39 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Delete snapshot completed successfully.
Apr 20 17:31:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3cfe8247-fe84-4906-902e-9ca76912036e tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-7e405b1c-8c08-4f28-95d7-022d1b9d8212-delete_snapshot" released by "delete_snapshot" :: held 2.541s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:39 devstack sudo[85438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 1073741824
Apr 20 17:31:39 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:40 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 1073741824" returned: 0 in 0.723s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "cinder-84727056-cadf-4e6b-b277-cccbc22dff42-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:40 devstack sudo[85449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2
Apr 20 17:31:40 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-84727056-cadf-4e6b-b277-cccbc22dff42-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Flow 'volume_create_manager' (cd361528-6404-45d0-addf-b6154a871447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1625731f-eb5f-4aa9-8499-604531d1148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1625731f-eb5f-4aa9-8499-604531d1148c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2063402191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b3737a-7391-45d8-8693-54908707df6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab5886050a04818b1d29b8543469d25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:40Z,use_quota=True,user_id='e52ccdcab8304f8fb912b7845ce2242d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87dca938-636d-4f6a-be74-60b7f0547f47),volume_type_id=87dca938-636d-4f6a-be74-60b7f0547f47)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ebabc5-8ce1-42d7-bd51-9733751c6939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ebabc5-8ce1-42d7-bd51-9733751c6939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e744398-84cf-4cef-8065-cadd54d53ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e744398-84cf-4cef-8065-cadd54d53ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b3737a-7391-45d8-8693-54908707df6c', 'volume_name': 'volume-c3b3737a-7391-45d8-8693-54908707df6c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787072fb-e9b0-40f5-9ad3-8aec96a60dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787072fb-e9b0-40f5-9ad3-8aec96a60dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd02cb42-9e1e-4411-adc2-9b692f4dd9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:40 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Volume c3b3737a-7391-45d8-8693-54908707df6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b3737a-7391-45d8-8693-54908707df6c', 'volume_size': 1}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0fcd86-53b5-460c-8331-c1190ac9e111]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:40 devstack sudo[85451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42
Apr 20 17:31:40 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:40 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" returned: 0 in 0.466s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2063402191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b3737a-7391-45d8-8693-54908707df6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab5886050a04818b1d29b8543469d25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:40Z,use_quota=True,user_id='e52ccdcab8304f8fb912b7845ce2242d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87dca938-636d-4f6a-be74-60b7f0547f47),volume_type_id=87dca938-636d-4f6a-be74-60b7f0547f47)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Creating volume c3b3737a-7391-45d8-8693-54908707df6c {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:40 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:40 devstack sudo[85454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c 1073741824
Apr 20 17:31:40 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbae47c-5277-4a62-9cdc-14671b3e1178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed59ff0-c40f-40ac-81b7-a7d2273f3917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:40 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Volume volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 (76c1d57b-1307-4e34-a18e-46adeeb6f9f2): created successfully
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed59ff0-c40f-40ac-81b7-a7d2273f3917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Flow 'volume_create_manager' (788676b2-4d2c-4d80-abbf-516b8cce4430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:40 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ed670efe-92fe-41c0-aca7-b9d84fe329c8 tempest-GroupSnapshotsTest-1386276573 None] Created volume successfully.
Apr 20 17:31:40 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42" returned: 0 in 0.532s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:40 devstack sudo[85459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42
Apr 20 17:31:40 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:41 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c 1073741824" returned: 0 in 0.670s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:41 devstack sudo[85466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c
Apr 20 17:31:41 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:41 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-84727056-cadf-4e6b-b277-cccbc22dff42" returned: 0 in 0.607s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-quobyte-84727056-cadf-4e6b-b277-cccbc22dff42" released by "delete_volume" :: held 1.176s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Created reservations ['7241a703-e073-4569-9689-9abb2ff04169', 'd8d3cdab-0fd9-4c52-8388-eb211482616a', 'ab1e2b13-45ae-40e8-8ca5-aea1a41bce9c', '01824406-8c59-4d17-abbe-5d1e74615583'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:41 devstack sudo[85468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:41 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Flow 'volume_create_manager' (55f1c8dc-77e2-454f-8e5b-4865eed7efcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945e9ae6-e52c-4049-942b-6405ae2d9ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945e9ae6-e52c-4049-942b-6405ae2d9ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-198564274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e1dbde4d-e2e8-44db-b86a-9b14634e199e,host='devstack@QuobyteHD#QuobyteHD',id=c6c54362-e8aa-47ed-9452-58732edfe17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d7085181644cfba5a4476f6e35122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:42Z,use_quota=True,user_id='b4271f90d7e240dc8c92cf129888ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e23464-e630-4984-b5aa-187b6977ca10),volume_type_id=a3e23464-e630-4984-b5aa-187b6977ca10)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafb58b4-a130-4cea-9e3a-e67e1353e42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafb58b4-a130-4cea-9e3a-e67e1353e42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cd0439-20b0-4f2c-ad3d-c7dc0f8debdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cd0439-20b0-4f2c-ad3d-c7dc0f8debdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c54362-e8aa-47ed-9452-58732edfe17c', 'volume_name': 'volume-c6c54362-e8aa-47ed-9452-58732edfe17c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af70951a-0d67-4faf-be88-0aaba1e8918f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af70951a-0d67-4faf-be88-0aaba1e8918f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4ecdfb-f842-4e9a-9c7e-d588ec4afa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:41 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Volume c6c54362-e8aa-47ed-9452-58732edfe17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c54362-e8aa-47ed-9452-58732edfe17c', 'volume_size': 1}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:41 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c" returned: 0 in 0.583s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e1dbde4d-e2e8-44db-b86a-9b14634e199e,created_at=2026-04-20T15:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-198564274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e1dbde4d-e2e8-44db-b86a-9b14634e199e,host='devstack@QuobyteHD#QuobyteHD',id=c6c54362-e8aa-47ed-9452-58732edfe17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d7085181644cfba5a4476f6e35122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:42Z,use_quota=True,user_id='b4271f90d7e240dc8c92cf129888ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3e23464-e630-4984-b5aa-187b6977ca10),volume_type_id=a3e23464-e630-4984-b5aa-187b6977ca10)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Creating volume c6c54362-e8aa-47ed-9452-58732edfe17c {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:41 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:41 devstack sudo[85472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c 1073741824
Apr 20 17:31:41 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd02cb42-9e1e-4411-adc2-9b692f4dd9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b3737a-7391-45d8-8693-54908707df6c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb191bce-3a80-4571-8d3f-cd06001ae322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:42 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Volume volume-c3b3737a-7391-45d8-8693-54908707df6c (c3b3737a-7391-45d8-8693-54908707df6c): created successfully
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb191bce-3a80-4571-8d3f-cd06001ae322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Flow 'volume_create_manager' (cd361528-6404-45d0-addf-b6154a871447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-2148cbdc-4eeb-461e-9c09-6f9cd3a983c9 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Created volume successfully.
Apr 20 17:31:42 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.568s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Deleted volume successfully.
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c78c0bbd-afb9-4c15-8aa4-53f2e0485e3b tempest-SnapshotsActionsTest-1722502918 None] Lock "cinder-84727056-cadf-4e6b-b277-cccbc22dff42-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:42 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c 1073741824" returned: 0 in 0.686s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:42 devstack sudo[85480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c
Apr 20 17:31:42 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-46c641cf-43d4-4ce0-84fb-8428c96bd025 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-46c641cf-43d4-4ce0-84fb-8428c96bd025 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-46c641cf-43d4-4ce0-84fb-8428c96bd025 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-46c641cf-43d4-4ce0-84fb-8428c96bd025 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-46c641cf-43d4-4ce0-84fb-8428c96bd025 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-46c641cf-43d4-4ce0-84fb-8428c96bd025 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:42 devstack sudo[85482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:42 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:43 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c" returned: 0 in 0.606s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:43 devstack sudo[85486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:43 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4ecdfb-f842-4e9a-9c7e-d588ec4afa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c54362-e8aa-47ed-9452-58732edfe17c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cd73bc-5c7c-4204-81c8-776c46d95c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:43 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Volume volume-c6c54362-e8aa-47ed-9452-58732edfe17c (c6c54362-e8aa-47ed-9452-58732edfe17c): created successfully
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cd73bc-5c7c-4204-81c8-776c46d95c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Flow 'volume_create_manager' (55f1c8dc-77e2-454f-8e5b-4865eed7efcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:43 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-5b8db5b6-9654-42f5-8140-329463389fa8 tempest-GroupSnapshotsTest-1386276573 None] Created volume successfully.
Apr 20 17:31:43 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-46c641cf-43d4-4ce0-84fb-8428c96bd025 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.618s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-46c641cf-43d4-4ce0-84fb-8428c96bd025 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:43 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-46c641cf-43d4-4ce0-84fb-8428c96bd025 tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Retype volume completed successfully.
Apr 20 17:31:43 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.464s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Acquiring lock "cinder-c3b3737a-7391-45d8-8693-54908707df6c-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "cinder-c3b3737a-7391-45d8-8693-54908707df6c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Acquiring lock "cinder-quobyte-c3b3737a-7391-45d8-8693-54908707df6c" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "cinder-quobyte-c3b3737a-7391-45d8-8693-54908707df6c" acquired by "delete_volume" :: waited 0.018s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d7403d-ac79-4cac-b2be-150d2f72e8c3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:44 devstack sudo[85511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c
Apr 20 17:31:44 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:44 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-04b8d9bc-fccd-414e-b4b1-ac32490fca01 tempest-GroupSnapshotsTest-1386276573 None] Update group completed successfully.
Apr 20 17:31:44 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c" returned: 0 in 0.717s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:44 devstack sudo[85539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c
Apr 20 17:31:44 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:45 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-85b127a2-851f-40ec-9990-61ff1a6a6106 tempest-GroupSnapshotsTest-1386276573 None] Update group completed successfully.
Apr 20 17:31:45 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b3737a-7391-45d8-8693-54908707df6c" returned: 0 in 0.738s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "cinder-quobyte-c3b3737a-7391-45d8-8693-54908707df6c" released by "delete_volume" :: held 1.497s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:45 devstack cinder-volume[82690]: WARNING cinder.quota [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:31:45 devstack cinder-volume[82690]: WARNING cinder.quota [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:31:45 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Created reservations ['c3ca9103-d2cc-45d0-9689-307af3da0960', 'b72548a3-8af1-48da-be81-748dce2f4cc5', '432fa089-0648-4131-9a07-2a0e65306a19', 'ca37497a-321a-465f-8dc6-48f4b36168bc'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:45 devstack sudo[85543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:45 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:46 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.460s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:46 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:46 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Deleted volume successfully.
Apr 20 17:31:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4005f5b7-e106-45ee-a3b8-bf611bc9a71a tempest-VolumeRetypeWithoutMigrationTest-2041357119 None] Lock "cinder-c3b3737a-7391-45d8-8693-54908707df6c-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:46 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ebaa775a-883a-427b-b52f-3ea83a2ca34a tempest-GroupSnapshotsTest-1386276573 None] Update group completed successfully.
Apr 20 17:31:47 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e47c10d4-d662-4049-b31f-9129a3ad4375 tempest-GroupSnapshotsTest-1386276573 None] Update group completed successfully.
Apr 20 17:31:49 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] GroupSnapshot 089ac14e-586f-473a-bee5-5e215364ef17: creating.
Apr 20 17:31:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Group snapshot 089ac14e-586f-473a-bee5-5e215364ef17: creating. {{(pid=82690) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 17:31:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Creating offline snapshot 61ffc2bd-7275-4403-ac7d-73267099589b of volume c6c54362-e8aa-47ed-9452-58732edfe17c {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:31:49 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1133ad-066c-4d50-bfe7-468b894f38a3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:49 devstack sudo[85572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c
Apr 20 17:31:49 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:49 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c" returned: 0 in 0.565s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:49 devstack sudo[85578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b 1G
Apr 20 17:31:49 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:50 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b 1G" returned: 0 in 0.532s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c54362-e8aa-47ed-9452-58732edfe17c -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:50 devstack sudo[85585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c54362-e8aa-47ed-9452-58732edfe17c -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b
Apr 20 17:31:50 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:UPDATE=189,cinder:SELECT=184,cinder:DELETE=9,cinder:INSERT=42 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Flow 'volume_create_manager' (70f59d6f-9a97-47f6-b536-b055b656e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f7d440-8c85-4dc8-a3b8-8ecea4c8c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f7d440-8c85-4dc8-a3b8-8ecea4c8c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-937519197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8291279e-22db-4222-8177-b573031a9fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e38da854d8f446b90a21d8e51634223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:51Z,use_quota=True,user_id='99424e3e49ca4fceb163c37fbc0aacf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ce54ec-3fdb-4d22-8cd8-d9c8989756c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ce54ec-3fdb-4d22-8cd8-d9c8989756c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75579aaa-574e-4af0-8804-e7e8cc040de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75579aaa-574e-4af0-8804-e7e8cc040de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8291279e-22db-4222-8177-b573031a9fe7', 'volume_name': 'volume-8291279e-22db-4222-8177-b573031a9fe7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18130201-00e0-42d4-96ae-20568645cd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18130201-00e0-42d4-96ae-20568645cd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6954d8a1-6846-4b0a-b45b-caa24689f413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:50 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Volume 8291279e-22db-4222-8177-b573031a9fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8291279e-22db-4222-8177-b573031a9fe7', 'volume_size': 1}
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:50 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c54362-e8aa-47ed-9452-58732edfe17c -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b" returned: 0 in 0.492s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:50 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:50 devstack sudo[85591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b
Apr 20 17:31:50 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:50 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-8250eebd-a596-47b7-bb46-6c57050fd35f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Terminate volume connection completed successfully.
Apr 20 17:31:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-8250eebd-a596-47b7-bb46-6c57050fd35f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Deleting attachment 71c99c80-5db4-48e4-b477-eca677d74772. {{(pid=82690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 20 17:31:51 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b" returned: 0 in 0.424s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:UPDATE=185,cinder:SELECT=188,cinder:INSERT=56,cinder:DELETE=13 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:51 devstack sudo[85594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.info
Apr 20 17:31:51 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "cinder-cf507be0-70b5-409d-a346-6d48b481c443-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "cinder-cf507be0-70b5-409d-a346-6d48b481c443-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "cinder-quobyte-cf507be0-70b5-409d-a346-6d48b481c443" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "cinder-quobyte-cf507be0-70b5-409d-a346-6d48b481c443" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[268e3eda-6219-4254-8fe9-1f2ffd7a6bf1]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:51 devstack sudo[85596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443
Apr 20 17:31:51 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:51 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.info" returned: 0 in 0.532s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:51 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:31:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:51 devstack sudo[85599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.info
Apr 20 17:31:51 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:52 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443" returned: 0 in 0.600s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:52 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.info" returned: 0 in 0.476s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.078s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:52 devstack sudo[85605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443
Apr 20 17:31:52 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Creating offline snapshot aaf9045a-d62b-4d36-b850-bd2aef85528b of volume 76c1d57b-1307-4e34-a18e-46adeeb6f9f2 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[679fbb89-f2ae-40d2-a48e-3e34def2ceb5]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:52 devstack sudo[85607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2
Apr 20 17:31:52 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:52 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443" returned: 1 in 0.574s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:52 devstack sudo[85614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443
Apr 20 17:31:52 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:52 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" returned: 0 in 0.563s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:52 devstack sudo[85617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b 1G
Apr 20 17:31:52 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:53 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cf507be0-70b5-409d-a346-6d48b481c443" returned: 0 in 0.446s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "cinder-quobyte-cf507be0-70b5-409d-a346-6d48b481c443" released by "delete_volume" :: held 1.672s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG cinder.quota [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Created reservations ['8d471339-460a-4db9-89d2-7711ae2c49b6', '6c1db0b0-2884-4371-b004-7031981541ee', '42924f2e-03a4-421f-90df-cb87a0dd7cef', 'a608dfbf-67f0-4355-9887-33aa5fd2f22e'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:53 devstack sudo[85623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:53 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:53 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b 1G" returned: 0 in 0.543s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:53 devstack sudo[85625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b
Apr 20 17:31:53 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:53 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.514s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG cinder.manager [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:53 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Deleted volume successfully.
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-6fabcdc8-e2d1-4171-8538-079cd5914fa1 req-67de6151-4660-4433-8e05-4dcf26bcc55f tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "cinder-cf507be0-70b5-409d-a346-6d48b481c443-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:53 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b" returned: 0 in 0.545s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:53 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:31:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:53 devstack sudo[85631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b
Apr 20 17:31:53 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Flow 'volume_create_manager' (a38d620d-63c2-4240-a54a-19d9bdb15f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322fcdc7-aaf7-417e-b65f-96e0c42ba273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322fcdc7-aaf7-417e-b65f-96e0c42ba273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2088102374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e996a407-6d91-438c-a543-2cfe89fe89f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a81f58572f0549eab0c9de782db963f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:54Z,use_quota=True,user_id='1c1d393622424759b98108f1552b6c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b4bdb4-9165-4524-8c8d-66ade042aaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b4bdb4-9165-4524-8c8d-66ade042aaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ea6e93-4271-4448-9612-c2f51868dce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ea6e93-4271-4448-9612-c2f51868dce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e996a407-6d91-438c-a543-2cfe89fe89f7', 'volume_name': 'volume-e996a407-6d91-438c-a543-2cfe89fe89f7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefa659e-e25e-45c9-be1d-bec23f442e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefa659e-e25e-45c9-be1d-bec23f442e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3126786d-544e-4da7-881e-bda4e9a6cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:54 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Volume e996a407-6d91-438c-a543-2cfe89fe89f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e996a407-6d91-438c-a543-2cfe89fe89f7', 'volume_size': 1}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:54 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b" returned: 0 in 0.453s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:54 devstack sudo[85634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.info
Apr 20 17:31:54 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:54 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.info" returned: 0 in 0.452s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:54 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:31:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:54 devstack sudo[85637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.info
Apr 20 17:31:54 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:55 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.info" returned: 0 in 0.437s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.051s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.532s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-937519197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8291279e-22db-4222-8177-b573031a9fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e38da854d8f446b90a21d8e51634223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:51Z,use_quota=True,user_id='99424e3e49ca4fceb163c37fbc0aacf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Creating volume 8291279e-22db-4222-8177-b573031a9fe7 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:55 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:55 devstack sudo[85647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7 1073741824
Apr 20 17:31:55 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c2e81c1f-e4cd-427c-ae90-2d8acdcce5b1 tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 089ac14e-586f-473a-bee5-5e215364ef17: created successfully
Apr 20 17:31:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 089ac14e-586f-473a-bee5-5e215364ef17: deleting
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 089ac14e-586f-473a-bee5-5e215364ef17: deleting {{(pid=82690) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-c6c54362-e8aa-47ed-9452-58732edfe17c" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-c6c54362-e8aa-47ed-9452-58732edfe17c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-61ffc2bd-7275-4403-ac7d-73267099589b" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-61ffc2bd-7275-4403-ac7d-73267099589b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Deleting offline snapshot 61ffc2bd-7275-4403-ac7d-73267099589b of volume c6c54362-e8aa-47ed-9452-58732edfe17c {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] snapshot_file for this snap is: volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[22842357-425a-4ae5-9d71-1f3adba0530b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:55 devstack sudo[85649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b
Apr 20 17:31:55 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:55 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7 1073741824" returned: 0 in 0.541s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:55 devstack sudo[85654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7
Apr 20 17:31:55 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:56 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b" returned: 0 in 0.657s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c54362-e8aa-47ed-9452-58732edfe17c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42102b1-8a1c-450d-aecd-7c53afb3f562]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:56 devstack sudo[85687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c
Apr 20 17:31:56 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:56 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7" returned: 0 in 0.535s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2088102374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e996a407-6d91-438c-a543-2cfe89fe89f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a81f58572f0549eab0c9de782db963f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:31:54Z,use_quota=True,user_id='1c1d393622424759b98108f1552b6c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Creating volume e996a407-6d91-438c-a543-2cfe89fe89f7 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:31:56 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6954d8a1-6846-4b0a-b45b-caa24689f413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8291279e-22db-4222-8177-b573031a9fe7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805965bb-8616-4557-9e8b-85d1826b17f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:56 devstack sudo[85690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7 1073741824
Apr 20 17:31:56 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:56 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Volume volume-8291279e-22db-4222-8177-b573031a9fe7 (8291279e-22db-4222-8177-b573031a9fe7): created successfully
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805965bb-8616-4557-9e8b-85d1826b17f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Flow 'volume_create_manager' (70f59d6f-9a97-47f6-b536-b055b656e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-525df12e-168a-4a08-8587-896fadd7354d tempest-VolumesServicesTestJSON-829677644 None] Created volume successfully.
Apr 20 17:31:56 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c" returned: 0 in 0.543s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:56 devstack sudo[85699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b
Apr 20 17:31:56 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:56 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7 1073741824" returned: 0 in 0.516s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:56 devstack sudo[85701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7
Apr 20 17:31:56 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Acquiring lock "cinder-8291279e-22db-4222-8177-b573031a9fe7-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Lock "cinder-8291279e-22db-4222-8177-b573031a9fe7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Acquiring lock "cinder-quobyte-8291279e-22db-4222-8177-b573031a9fe7" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Lock "cinder-quobyte-8291279e-22db-4222-8177-b573031a9fe7" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6f2234-5e13-4bb3-9203-bf421d1cbcec]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:57 devstack sudo[85706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7
Apr 20 17:31:57 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:57 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b" returned: 0 in 0.500s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:57 devstack sudo[85709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b
Apr 20 17:31:57 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:57 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7" returned: 0 in 0.523s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3126786d-544e-4da7-881e-bda4e9a6cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e996a407-6d91-438c-a543-2cfe89fe89f7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c28b9e3-d874-4691-bb94-c770d05f3fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:31:57 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Volume volume-e996a407-6d91-438c-a543-2cfe89fe89f7 (e996a407-6d91-438c-a543-2cfe89fe89f7): created successfully
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c28b9e3-d874-4691-bb94-c770d05f3fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Flow 'volume_create_manager' (a38d620d-63c2-4240-a54a-19d9bdb15f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:31:57 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-51bb5844-40c4-44d3-9c27-44342070dd8a tempest-AbsoluteLimitsTests-2089888485 None] Created volume successfully.
Apr 20 17:31:57 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7" returned: 0 in 0.593s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:57 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c.61ffc2bd-7275-4403-ac7d-73267099589b" returned: 0 in 0.488s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:57 devstack sudo[85717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7
Apr 20 17:31:57 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-61ffc2bd-7275-4403-ac7d-73267099589b" released by "_delete_snapshot" :: held 2.240s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-c6c54362-e8aa-47ed-9452-58732edfe17c" released by "delete_snapshot" :: held 2.256s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-aaf9045a-d62b-4d36-b850-bd2aef85528b" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-aaf9045a-d62b-4d36-b850-bd2aef85528b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Deleting offline snapshot aaf9045a-d62b-4d36-b850-bd2aef85528b of volume 76c1d57b-1307-4e34-a18e-46adeeb6f9f2 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] snapshot_file for this snap is: volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbc9ccb-3e62-4dd9-8716-c6d487232d4c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:57 devstack sudo[85719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b
Apr 20 17:31:57 devstack sudo[85719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:58 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8291279e-22db-4222-8177-b573031a9fe7" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Lock "cinder-quobyte-8291279e-22db-4222-8177-b573031a9fe7" released by "delete_volume" :: held 1.102s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Created reservations ['0521d23c-a38b-4d04-b4d1-c29c31976dad', 'cb201909-3ead-438e-ab43-c9b132fed0f6', '4717d6dd-d6ce-4f98-a3a5-0368a8a4b71e', '39f931c6-f305-4dd0-bbdc-79ee0e717711'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Acquiring lock "cinder-e996a407-6d91-438c-a543-2cfe89fe89f7-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:58 devstack sudo[85726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:58 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Lock "cinder-e996a407-6d91-438c-a543-2cfe89fe89f7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:58 devstack sudo[85719]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Acquiring lock "cinder-quobyte-e996a407-6d91-438c-a543-2cfe89fe89f7" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b" returned: 0 in 0.553s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Lock "cinder-quobyte-e996a407-6d91-438c-a543-2cfe89fe89f7" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[8939585b-1192-448d-9c07-eb7833bc7a04]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[820e9d04-aace-4d3e-b3a4-b7a6b6750c44]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:58 devstack sudo[85728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2
Apr 20 17:31:58 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:58 devstack sudo[85729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7
Apr 20 17:31:58 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:58 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.458s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:31:58 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Deleted volume successfully.
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a22753-1698-495f-aed5-e9a918fcb959 tempest-VolumesServicesTestJSON-829677644 None] Lock "cinder-8291279e-22db-4222-8177-b573031a9fe7-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:58 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" returned: 0 in 0.489s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:58 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:58 devstack sudo[85739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7" returned: 0 in 0.500s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:58 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:58 devstack sudo[85741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7
Apr 20 17:31:58 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:59 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e996a407-6d91-438c-a543-2cfe89fe89f7" returned: 0 in 0.457s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Lock "cinder-quobyte-e996a407-6d91-438c-a543-2cfe89fe89f7" released by "delete_volume" :: held 0.984s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:59 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b" returned: 0 in 0.501s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:59 devstack sudo[85747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b
Apr 20 17:31:59 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Created reservations ['1ddb20ba-5ea4-4dce-8a08-9588321412fd', '992c0219-3082-430d-b50a-ebb83dc63352', '741e050b-9de9-4b4a-ae40-14e27d366f9a', 'ee124f3d-de03-4543-9d7e-4b7662fde88f'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:31:59 devstack sudo[85749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:31:59 devstack sudo[85749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:31:59 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2.aaf9045a-d62b-4d36-b850-bd2aef85528b" returned: 0 in 0.500s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-aaf9045a-d62b-4d36-b850-bd2aef85528b" released by "_delete_snapshot" :: held 2.094s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:31:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" released by "delete_snapshot" :: held 2.104s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:00 devstack cinder-volume[82690]: WARNING cinder.quota [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-578988410 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-578988410, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:00 devstack cinder-volume[82690]: WARNING cinder.quota [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-578988410 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-578988410, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:00 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['8565ccae-5890-44de-b1db-cf2a986de0cc', '9433b8c9-3866-4695-947c-06e354d924f9', '1eda64eb-2183-44f7-b409-944a54fe399f', '01913a0b-fd74-4ecc-9027-e93debafd9ad'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:00 devstack sudo[85749]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.502s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:00 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:00 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Deleted volume successfully.
Apr 20 17:32:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0190f673-ac4c-4d70-b610-7e8b9566e0c5 tempest-AbsoluteLimitsTests-2089888485 None] Lock "cinder-e996a407-6d91-438c-a543-2cfe89fe89f7-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:00 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['16a2d3ff-0056-423b-893d-f4c7c462a5e0', 'c4f29fc2-cd14-4234-8411-9f14bc950e12', '31c3d3ec-42a3-4835-bf42-f4931ba4ab3d', '0d91edaf-dc9d-499f-ac1f-ba7f094f879f'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:00 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ce061cb9-485a-4e7f-bebd-b8d3b7b01976 tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 089ac14e-586f-473a-bee5-5e215364ef17: deleted successfully
Apr 20 17:32:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:01 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[301b2c49-f11c-4e63-829f-e3f3fce4e371]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:01 devstack sudo[85754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2
Apr 20 17:32:01 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:01 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" returned: 0 in 0.645s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:01 devstack sudo[85793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2
Apr 20 17:32:01 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:02 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" returned: 0 in 0.684s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-76c1d57b-1307-4e34-a18e-46adeeb6f9f2" released by "delete_volume" :: held 1.390s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-c6c54362-e8aa-47ed-9452-58732edfe17c" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-c6c54362-e8aa-47ed-9452-58732edfe17c" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:02 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6465cf44-e799-4f47-b64b-039337ad3c2c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:02 devstack sudo[85817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c
Apr 20 17:32:02 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:03 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c" returned: 0 in 0.677s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:03 devstack sudo[85824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c
Apr 20 17:32:03 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:03 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c6c54362-e8aa-47ed-9452-58732edfe17c" returned: 0 in 0.478s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-c6c54362-e8aa-47ed-9452-58732edfe17c" released by "delete_volume" :: held 1.189s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:03 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['7182bfa4-0820-4c2e-9e52-d8734dc72a1f'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:03 devstack cinder-volume[82690]: WARNING cinder.quota [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-578988410 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-578988410, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:03 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['26fa89bd-5e2f-48e9-81f2-beaa0f53511f', '6d7c1f47-1045-477f-8a54-62ee5b5ff360', '08d58cc6-80f0-473c-8eaa-4a1f8d8f715a', '9fe9a0e5-dcfd-4700-a56c-33a589f8a19e'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:03 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['1227501b-56bc-46a0-b64c-32eaf32c2382', 'c8035f00-b99f-48fe-9f75-3356c4f3ffd7', '97a341f8-0743-4b8e-b709-fb1fc2ba38df', '5e811587-e2de-4fb9-8261-ea956df77d1d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:04 devstack sudo[85830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:04 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:04 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.568s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:04 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:04 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ce9e3c4d-03a8-4159-95f1-aa280da4755b tempest-GroupSnapshotsTest-1386276573 None] Delete group completed successfully.
Apr 20 17:32:04 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9e73f6b2-cb01-4de3-9ca1-12df49bb6a07 tempest-GroupSnapshotsTest-1386276573 None] Group tempest-GroupSnapshotsTest-Group-2066333222: creating
Apr 20 17:32:04 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9e73f6b2-cb01-4de3-9ca1-12df49bb6a07 tempest-GroupSnapshotsTest-1386276573 None] Group tempest-GroupSnapshotsTest-Group-2066333222: created successfully
Apr 20 17:32:04 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9e73f6b2-cb01-4de3-9ca1-12df49bb6a07 tempest-GroupSnapshotsTest-1386276573 None] Create group completed successfully.
Apr 20 17:32:04 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-15f84f5b-8c3a-4124-91ef-7f7b1e912168 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Terminate volume connection completed successfully.
Apr 20 17:32:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-15f84f5b-8c3a-4124-91ef-7f7b1e912168 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Deleting attachment 3d88dcc5-5542-4849-b60b-6db11931e61c. {{(pid=82690) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Flow 'volume_create_manager' (978b6ef1-cd20-435b-9c5c-940b84aa7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d31c40-eb67-4bd0-b6a6-6db39eab0417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d31c40-eb67-4bd0-b6a6-6db39eab0417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1519015021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1959425d-361e-49a7-a6f4-41f1f787159b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ce0783dea946d1a58b41367f4f7607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:05Z,use_quota=True,user_id='c8705eb231434ed7bb22717f5fbfa5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ac838-9ccc-458e-ae69-61be80ea16c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ac838-9ccc-458e-ae69-61be80ea16c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f98b247-af8e-4ecf-9db2-8e0eadd0475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f98b247-af8e-4ecf-9db2-8e0eadd0475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1959425d-361e-49a7-a6f4-41f1f787159b', 'volume_name': 'volume-1959425d-361e-49a7-a6f4-41f1f787159b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48bc528-e0af-463c-a983-6482885907f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48bc528-e0af-463c-a983-6482885907f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bdc783-f9ef-4e70-b540-b0077cd60a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:05 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Volume 1959425d-361e-49a7-a6f4-41f1f787159b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1959425d-361e-49a7-a6f4-41f1f787159b', 'volume_size': 1}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1519015021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1959425d-361e-49a7-a6f4-41f1f787159b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ce0783dea946d1a58b41367f4f7607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:05Z,use_quota=True,user_id='c8705eb231434ed7bb22717f5fbfa5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Creating volume 1959425d-361e-49a7-a6f4-41f1f787159b {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:05 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:05 devstack sudo[85834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b 1073741824
Apr 20 17:32:05 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "cinder-7f8991b9-f89b-4063-a416-9c5a9a66df29-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "cinder-7f8991b9-f89b-4063-a416-9c5a9a66df29-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "cinder-quobyte-7f8991b9-f89b-4063-a416-9c5a9a66df29" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "cinder-quobyte-7f8991b9-f89b-4063-a416-9c5a9a66df29" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd9ba14-440c-41d1-8515-8e59a4c3e2bb]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:05 devstack sudo[85836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29
Apr 20 17:32:05 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:05 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b 1073741824" returned: 0 in 0.513s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:05 devstack sudo[85841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b
Apr 20 17:32:05 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Flow 'volume_create_manager' (544d9bfc-2b3e-4afa-87b0-f952ef5e276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:06 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6650c14-c522-4ebc-ba94-804aa5cc74ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29" returned: 0 in 0.660s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:06 devstack sudo[85847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29
Apr 20 17:32:06 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6650c14-c522-4ebc-ba94-804aa5cc74ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1601959947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d52954cb-259a-4b11-b311-22315ee0f0a6,host='devstack@QuobyteHD#QuobyteHD',id=801116cf-6abe-42d3-ab7f-5bc37dbe08ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d7085181644cfba5a4476f6e35122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:06Z,use_quota=True,user_id='b4271f90d7e240dc8c92cf129888ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df084097-2de3-491c-9168-095f1d609de2),volume_type_id=df084097-2de3-491c-9168-095f1d609de2)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84b35a7-4dbe-4e58-8b80-e10a64fb4c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84b35a7-4dbe-4e58-8b80-e10a64fb4c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb0e2f7-7d8c-4d48-aa53-ceee22fea51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb0e2f7-7d8c-4d48-aa53-ceee22fea51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801116cf-6abe-42d3-ab7f-5bc37dbe08ba', 'volume_name': 'volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77de8679-b11d-46ad-a5ff-2a12d5a53189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77de8679-b11d-46ad-a5ff-2a12d5a53189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c865f1bb-5b8d-4182-9e0d-6d9db762ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:06 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Volume 801116cf-6abe-42d3-ab7f-5bc37dbe08ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba', 'volume_size': 1}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:06 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b" returned: 0 in 0.569s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.096s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d52954cb-259a-4b11-b311-22315ee0f0a6,created_at=2026-04-20T15:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1601959947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d52954cb-259a-4b11-b311-22315ee0f0a6,host='devstack@QuobyteHD#QuobyteHD',id=801116cf-6abe-42d3-ab7f-5bc37dbe08ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='594d7085181644cfba5a4476f6e35122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:06Z,use_quota=True,user_id='b4271f90d7e240dc8c92cf129888ffe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df084097-2de3-491c-9168-095f1d609de2),volume_type_id=df084097-2de3-491c-9168-095f1d609de2)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Creating volume 801116cf-6abe-42d3-ab7f-5bc37dbe08ba {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:06 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bdc783-f9ef-4e70-b540-b0077cd60a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1959425d-361e-49a7-a6f4-41f1f787159b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:06 devstack sudo[85850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba 1073741824
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a95dbbd-187b-4e73-9d96-5a072fd2e8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:06 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:06 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Volume volume-1959425d-361e-49a7-a6f4-41f1f787159b (1959425d-361e-49a7-a6f4-41f1f787159b): created successfully
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a95dbbd-187b-4e73-9d96-5a072fd2e8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Flow 'volume_create_manager' (978b6ef1-cd20-435b-9c5c-940b84aa7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:06 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-75ae2ec2-98a9-49f0-961d-772075a22cf2 tempest-VolumesTransfersV357Test-1611418907 None] Created volume successfully.
Apr 20 17:32:06 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7f8991b9-f89b-4063-a416-9c5a9a66df29" returned: 0 in 0.469s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "cinder-quobyte-7f8991b9-f89b-4063-a416-9c5a9a66df29" released by "delete_volume" :: held 1.176s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.quota [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Created reservations ['65523680-5d49-496e-aae0-a66d5dcf8095', 'e9e1d706-d275-4488-a2ac-10da6399f219', 'f5eb6de0-4e30-4fb6-99e3-143393e34b8c', '0d907ea2-4d37-4aa0-88ae-98ad6239bdbf'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:06 devstack sudo[85856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:06 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:07 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba 1073741824" returned: 0 in 0.556s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:07 devstack sudo[85858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba
Apr 20 17:32:07 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:07 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.554s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG cinder.manager [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:07 devstack cinder-volume[82690]: INFO cinder.volume.manager [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Deleted volume successfully.
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG cinder.coordination [req-7dc5f2ff-02ff-4bdc-b6d1-033b16ac436b req-33ddc098-9079-4e90-b267-016dd3423712 tempest-ServerBootFromVolumeStableRescueTest-1050858724 None] Lock "cinder-7f8991b9-f89b-4063-a416-9c5a9a66df29-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:07 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" returned: 0 in 0.573s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c865f1bb-5b8d-4182-9e0d-6d9db762ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a710f178-1f5c-4f7c-8881-16ab07597a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:07 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Volume volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba (801116cf-6abe-42d3-ab7f-5bc37dbe08ba): created successfully
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a710f178-1f5c-4f7c-8881-16ab07597a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:07 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Flow 'volume_create_manager' (544d9bfc-2b3e-4afa-87b0-f952ef5e276c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:07 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-1f5fed84-94ea-4d73-adfd-ac8df8a4b009 tempest-GroupSnapshotsTest-1386276573 None] Created volume successfully.
Apr 20 17:32:07 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e65ad0f2-4a6e-4437-a7f1-667eb3c25936 tempest-VolumesTransfersV357Test-2870164 None] Transfer volume completed successfully.
Apr 20 17:32:08 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] GroupSnapshot 507f1e93-ceb4-422c-ae91-ee56c6adc7b3: creating.
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Group snapshot 507f1e93-ceb4-422c-ae91-ee56c6adc7b3: creating. {{(pid=82690) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Creating offline snapshot 1277519b-6684-4916-95d1-3544f8e2f7dc of volume 801116cf-6abe-42d3-ab7f-5bc37dbe08ba {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b780c4-6b66-49dd-8d5b-1e260caf8a32]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:08 devstack sudo[85863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba
Apr 20 17:32:08 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Acquiring lock "cinder-1959425d-361e-49a7-a6f4-41f1f787159b-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Lock "cinder-1959425d-361e-49a7-a6f4-41f1f787159b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Acquiring lock "cinder-quobyte-1959425d-361e-49a7-a6f4-41f1f787159b" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Lock "cinder-quobyte-1959425d-361e-49a7-a6f4-41f1f787159b" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5eaf5-cc63-4a50-bfbf-ef1d04268651]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:09 devstack sudo[85866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b
Apr 20 17:32:09 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:09 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" returned: 0 in 0.717s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:09 devstack sudo[85871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc 1G
Apr 20 17:32:09 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Flow 'volume_create_manager' (445cb3f6-32a6-4d6c-a426-c4704b8240cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31011900-d3fd-4058-9c91-ecb27eaca816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31011900-d3fd-4058-9c91-ecb27eaca816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2020675120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ee649c-efdf-4773-9cc3-dd576a8b3837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5397c4cc4e542538c39af6fc5043a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:09Z,use_quota=True,user_id='023fe76f2eea4125adf1f6cc6147a1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959632d8-71df-4c76-9ed5-fbe8e8bafe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959632d8-71df-4c76-9ed5-fbe8e8bafe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a86c6a-1581-4b2e-bb51-1e3d7c0e7d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a86c6a-1581-4b2e-bb51-1e3d7c0e7d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ee649c-efdf-4773-9cc3-dd576a8b3837', 'volume_name': 'volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837', 'volume_size': 2}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df83a19e-5192-461d-9f58-c53ca426e627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df83a19e-5192-461d-9f58-c53ca426e627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d69fa58-91e8-4990-96bb-bb6d4aa5e7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:09 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Volume d8ee649c-efdf-4773-9cc3-dd576a8b3837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837', 'volume_size': 2}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:09 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b" returned: 0 in 0.532s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:09 devstack sudo[85876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b
Apr 20 17:32:09 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:09 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc 1G" returned: 0 in 0.519s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:09 devstack sudo[85887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc
Apr 20 17:32:09 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:09 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1959425d-361e-49a7-a6f4-41f1f787159b" returned: 0 in 0.462s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:09 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Lock "cinder-quobyte-1959425d-361e-49a7-a6f4-41f1f787159b" released by "delete_volume" :: held 1.040s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Created reservations ['29d1c333-e480-4225-9bc1-f771d82b9bf8', '07e7438c-dfa1-4698-aa31-bc453dd9c184', '4e8d55d6-50c5-4ad0-8aed-5c7f1e5d0d47', '9f91ffc9-7b6e-4589-83ea-32d98fa175e8'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:10 devstack sudo[85901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:10 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:10 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc" returned: 0 in 0.561s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:10 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:10 devstack sudo[85925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc
Apr 20 17:32:10 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:10 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.496s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Deleted volume successfully.
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-addda3a5-32fa-449f-af1c-eadb37e8c696 tempest-VolumesTransfersV357Test-1597585553 None] Lock "cinder-1959425d-361e-49a7-a6f4-41f1f787159b-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:10 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc" returned: 0 in 0.484s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:10 devstack sudo[85930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.info
Apr 20 17:32:10 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:11 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.info" returned: 0 in 0.448s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:11 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:11 devstack sudo[85934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.info
Apr 20 17:32:11 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Flow 'volume_create_manager' (e5e5614e-f441-4129-9689-01f9d07abc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895e6f7c-ad37-412d-83b5-0355a26d79e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895e6f7c-ad37-412d-83b5-0355a26d79e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-777168120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4941654-5250-4252-b142-c5d7aa8cf4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ce0783dea946d1a58b41367f4f7607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:11Z,use_quota=True,user_id='c8705eb231434ed7bb22717f5fbfa5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeee229-8b41-4c9f-b3b9-325428346df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeee229-8b41-4c9f-b3b9-325428346df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9231c7-ca0c-463b-820b-3885b8b78ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9231c7-ca0c-463b-820b-3885b8b78ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4941654-5250-4252-b142-c5d7aa8cf4f1', 'volume_name': 'volume-b4941654-5250-4252-b142-c5d7aa8cf4f1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb848af-fa74-4837-bddd-7d2dda289474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb848af-fa74-4837-bddd-7d2dda289474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5582f53c-4534-4c85-9a96-52ec7ad061c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:11 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Volume b4941654-5250-4252-b142-c5d7aa8cf4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4941654-5250-4252-b142-c5d7aa8cf4f1', 'volume_size': 1}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:11 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.info" returned: 0 in 0.488s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.268s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.401s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2020675120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ee649c-efdf-4773-9cc3-dd576a8b3837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5397c4cc4e542538c39af6fc5043a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:09Z,use_quota=True,user_id='023fe76f2eea4125adf1f6cc6147a1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Creating volume d8ee649c-efdf-4773-9cc3-dd576a8b3837 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:11 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837 2147483648 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:11 devstack sudo[85939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837 2147483648
Apr 20 17:32:11 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:11 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3235626b-a495-4d70-834e-9e240720a53e tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 507f1e93-ceb4-422c-ae91-ee56c6adc7b3: created successfully
Apr 20 17:32:12 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837 2147483648" returned: 0 in 0.508s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:12 devstack sudo[85945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837
Apr 20 17:32:12 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:12 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837" returned: 0 in 0.442s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-777168120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4941654-5250-4252-b142-c5d7aa8cf4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ce0783dea946d1a58b41367f4f7607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:11Z,use_quota=True,user_id='c8705eb231434ed7bb22717f5fbfa5e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Creating volume b4941654-5250-4252-b142-c5d7aa8cf4f1 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:12 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d69fa58-91e8-4990-96bb-bb6d4aa5e7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837', 'volume_size': 2}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:12 devstack sudo[85948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1 1073741824
Apr 20 17:32:12 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14eaba2-72d6-45bf-ad06-aed53566ae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:12 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Volume volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837 (d8ee649c-efdf-4773-9cc3-dd576a8b3837): created successfully
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14eaba2-72d6-45bf-ad06-aed53566ae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Flow 'volume_create_manager' (445cb3f6-32a6-4d6c-a426-c4704b8240cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4c6b8e1d-a92c-42da-b396-e182c247c952 tempest-VolumesCloneNegativeTest-30292236 None] Created volume successfully.
Apr 20 17:32:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 507f1e93-ceb4-422c-ae91-ee56c6adc7b3: deleting
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 507f1e93-ceb4-422c-ae91-ee56c6adc7b3: deleting {{(pid=82690) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-1277519b-6684-4916-95d1-3544f8e2f7dc" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-1277519b-6684-4916-95d1-3544f8e2f7dc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Deleting offline snapshot 1277519b-6684-4916-95d1-3544f8e2f7dc of volume 801116cf-6abe-42d3-ab7f-5bc37dbe08ba {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] snapshot_file for this snap is: volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c122be-e12e-4bd7-bab7-8fcb57b11166]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:12 devstack sudo[85950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc
Apr 20 17:32:12 devstack sudo[85950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:13 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1 1073741824" returned: 0 in 0.477s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:13 devstack sudo[85955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1
Apr 20 17:32:13 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:13 devstack sudo[85950]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc" returned: 0 in 0.512s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e23c6-7aa7-4fea-a208-fb2d22ca5a13]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:13 devstack sudo[85960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba
Apr 20 17:32:13 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Acquiring lock "cinder-d8ee649c-efdf-4773-9cc3-dd576a8b3837-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Lock "cinder-d8ee649c-efdf-4773-9cc3-dd576a8b3837-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Acquiring lock "cinder-quobyte-d8ee649c-efdf-4773-9cc3-dd576a8b3837" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Lock "cinder-quobyte-d8ee649c-efdf-4773-9cc3-dd576a8b3837" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7864d367-35e1-4619-bc2f-18fd96029110]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:13 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:13 devstack sudo[85963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837
Apr 20 17:32:13 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1" returned: 0 in 0.475s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5582f53c-4534-4c85-9a96-52ec7ad061c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4941654-5250-4252-b142-c5d7aa8cf4f1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e1dbbf-3140-427e-9d97-67ec6b10f2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:13 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Volume volume-b4941654-5250-4252-b142-c5d7aa8cf4f1 (b4941654-5250-4252-b142-c5d7aa8cf4f1): created successfully
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e1dbbf-3140-427e-9d97-67ec6b10f2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Flow 'volume_create_manager' (e5e5614e-f441-4129-9689-01f9d07abc37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:13 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-062bce17-915c-4c22-b8c3-01cae5d1d28b tempest-VolumesTransfersV357Test-1611418907 None] Created volume successfully.
Apr 20 17:32:13 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" returned: 0 in 0.486s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:13 devstack sudo[85968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc
Apr 20 17:32:13 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:14 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837" returned: 0 in 0.497s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:14 devstack sudo[85973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837
Apr 20 17:32:14 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:14 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc" returned: 0 in 0.470s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:14 devstack sudo[85978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc
Apr 20 17:32:14 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:14 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d8ee649c-efdf-4773-9cc3-dd576a8b3837" returned: 0 in 0.457s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Lock "cinder-quobyte-d8ee649c-efdf-4773-9cc3-dd576a8b3837" released by "delete_volume" :: held 0.983s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Created reservations ['8b9a20ce-81c5-484c-8eab-54fed39a4e59', 'b87c12b6-c2db-4bff-a698-6f4200a15cf8', '2be249e0-aa5c-43d0-aa8a-fb1f865fcc7e', 'b752917d-bce9-4ec4-8386-6f3933e38d7a'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:14 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:14 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Acquiring lock "cinder-b4941654-5250-4252-b142-c5d7aa8cf4f1-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Lock "cinder-b4941654-5250-4252-b142-c5d7aa8cf4f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Acquiring lock "cinder-quobyte-b4941654-5250-4252-b142-c5d7aa8cf4f1" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Lock "cinder-quobyte-b4941654-5250-4252-b142-c5d7aa8cf4f1" acquired by "delete_volume" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dad290-08ba-485e-93c4-283536a74c20]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:14 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba.1277519b-6684-4916-95d1-3544f8e2f7dc" returned: 0 in 0.530s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:14 devstack sudo[85985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1
Apr 20 17:32:14 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-1277519b-6684-4916-95d1-3544f8e2f7dc" released by "_delete_snapshot" :: held 2.067s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" released by "delete_snapshot" :: held 2.078s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:14 devstack cinder-volume[82690]: WARNING cinder.quota [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1530665337 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1530665337, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:14 devstack cinder-volume[82690]: WARNING cinder.quota [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1530665337 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1530665337, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:14 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['dd4d37f5-6663-4ac5-9822-bc32de01c492', 'd2284626-4787-4a6b-b3ba-94f48189b1b7', '46dc5fcd-14d5-4a30-8d43-cdf90c6c4e38', 'dfb283fe-b2a6-4652-9582-df8c31509ad5'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:15 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-eb7b9dd1-d5a6-4fd2-a6c0-5ab3e4336c3c tempest-GroupSnapshotsTest-1386276573 None] group_snapshot 507f1e93-ceb4-422c-ae91-ee56c6adc7b3: deleted successfully
Apr 20 17:32:15 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.556s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:15 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:15 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Deleted volume successfully.
Apr 20 17:32:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6beb0a86-1e0e-40ae-881b-fdf56768d448 tempest-VolumesCloneNegativeTest-30292236 None] Lock "cinder-d8ee649c-efdf-4773-9cc3-dd576a8b3837-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:15 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1" returned: 0 in 0.679s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:15 devstack sudo[85991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1
Apr 20 17:32:15 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:15 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4941654-5250-4252-b142-c5d7aa8cf4f1" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Lock "cinder-quobyte-b4941654-5250-4252-b142-c5d7aa8cf4f1" released by "delete_volume" :: held 1.182s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Created reservations ['6bb157b9-4b2d-4227-bf24-f7af0ec77441', 'efad916a-a450-46a8-acc5-c396efd51d4b', '745499c4-667a-4874-820d-3de4d4cf85b1', 'aac2ba99-5899-4dbf-b087-3fdbefb08921'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:16 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:16 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "cinder-quobyte-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[259c1e3b-d2f4-4f2e-acff-c20fea59de6a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:16 devstack sudo[85998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba
Apr 20 17:32:16 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:16 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.498s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:16 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Deleted volume successfully.
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-11f17f16-ea99-49d7-9f66-647906ef1fcc tempest-VolumesTransfersV357Test-1597585553 None] Lock "cinder-b4941654-5250-4252-b142-c5d7aa8cf4f1-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Flow 'volume_create_manager' (fe7f0f99-8e4b-4601-9bef-c73391d0267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de6f7e4-6ddc-4f54-943d-0e55188d18e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de6f7e4-6ddc-4f54-943d-0e55188d18e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-429183295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892daac7-9cec-4ef2-9eea-aa8eccb23c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b37f2fa0f2a41299b9c406c7edd270b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:17Z,use_quota=True,user_id='938acc8fa0dc4b218c0be807ff6a31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488c4ecb-acca-4fee-8360-36a45b790707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488c4ecb-acca-4fee-8360-36a45b790707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cfb1e5-b8ec-45eb-bd49-b42454f9b6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG cinder.image.glance [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Creating Keystone auth plugin from conf {{(pid=82690) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 17:32:16 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" returned: 0 in 0.678s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:16 devstack sudo[86004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba
Apr 20 17:32:16 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cfb1e5-b8ec-45eb-bd49-b42454f9b6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '892daac7-9cec-4ef2-9eea-aa8eccb23c61', 'volume_name': 'volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91bfd21a0>}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a688785d-2e1d-4e96-8a3f-27ca22b935f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a688785d-2e1d-4e96-8a3f-27ca22b935f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28784097-afe9-4bac-a688-ea711a5d3706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:17 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Volume 892daac7-9cec-4ef2-9eea-aa8eccb23c61: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91bfd21a0>}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Trying to clone 892daac7-9cec-4ef2-9eea-aa8eccb23c61 from image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]). {{(pid=82690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 17:32:17 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5544ba84-82ff-402a-94e6-5423b056e407]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:17 devstack sudo[86008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD
Apr 20 17:32:17 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:17 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" returned: 0 in 0.637s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Lock "cinder-quobyte-801116cf-6abe-42d3-ab7f-5bc37dbe08ba" released by "delete_volume" :: held 1.370s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['ea7cf557-9480-4cfd-9019-27737a8243ae'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:17 devstack cinder-volume[82690]: WARNING cinder.quota [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1530665337 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1530665337, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Created reservations ['b73869a0-752c-40ca-9020-8d3d19900045', '37859829-e657-48ca-b2ed-2fe41ce483a4', '0e2cf15e-8092-4acc-aefa-f31c27a552bf', '564cc20d-9557-4d0b-bdcf-7c4f2989a438'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:17 devstack sudo[86011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:17 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:18 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD" returned: 0 in 0.619s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Temporary image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e is fetched for user 938acc8fa0dc4b218c0be807ff6a31cf. {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[9748dfd5-cdb8-4cc3-ba4a-cc1b82d0137d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:18 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD
Apr 20 17:32:18 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:18 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.531s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:18 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-d4fefd6f-8608-4ae1-81cb-3111bafbb9dd tempest-GroupSnapshotsTest-1386276573 None] Delete group completed successfully.
Apr 20 17:32:18 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD" returned: 0 in 0.594s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-429183295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892daac7-9cec-4ef2-9eea-aa8eccb23c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b37f2fa0f2a41299b9c406c7edd270b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:17Z,use_quota=True,user_id='938acc8fa0dc4b218c0be807ff6a31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Creating volume 892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:18 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:18 devstack sudo[86022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 1073741824
Apr 20 17:32:18 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:19 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 1073741824" returned: 0 in 0.672s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:19 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61
Apr 20 17:32:19 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:20 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61" returned: 0 in 0.651s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:20 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Attempting download of 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}])) to volume 892daac7-9cec-4ef2-9eea-aa8eccb23c61. {{(pid=82690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 17:32:20 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aff0fc-8aeb-404c-ad24-b101af9694a6]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_ua5aq3wp {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:20 devstack sudo[86030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_ua5aq3wp
Apr 20 17:32:20 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:20 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_ua5aq3wp" returned: 0 in 0.663s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_ua5aq3wp {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:20 devstack sudo[86034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_ua5aq3wp
Apr 20 17:32:20 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Flow 'volume_create_manager' (35ff0147-e78d-420f-ac10-026a03c6a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776a2eff-5f39-49b7-b029-bea7d691c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776a2eff-5f39-49b7-b029-bea7d691c957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1586484576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69f28fc34064970bb30fe5da2b75bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:21Z,use_quota=True,user_id='2448a6d2990a4982ad6ff0ed33e9d53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c27490-b4be-4b9c-b28a-841bd534b3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c27490-b4be-4b9c-b28a-841bd534b3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1da91af-e294-4f9e-97fb-6ea5db62ebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1da91af-e294-4f9e-97fb-6ea5db62ebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98', 'volume_name': 'volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81afacda-c868-432f-9e5e-7474f58a876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81afacda-c868-432f-9e5e-7474f58a876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4537f99-48ca-47be-952c-e6bb91f6e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:21 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Volume 26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98', 'volume_size': 1}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1586484576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a69f28fc34064970bb30fe5da2b75bb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:21Z,use_quota=True,user_id='2448a6d2990a4982ad6ff0ed33e9d53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Creating volume 26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:21 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:21 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 1073741824
Apr 20 17:32:21 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:21 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_ua5aq3wp" returned: 1 in 0.692s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_ua5aq3wp' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e7b462-730f-4336-88a4-90dc057e16f8]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:21 devstack sudo[86040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD
Apr 20 17:32:21 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:22 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD" returned: 0 in 0.578s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e was qcow2, converting to raw {{(pid=82690) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:22 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 1073741824" returned: 0 in 0.644s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:22 devstack sudo[86048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61
Apr 20 17:32:22 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:22 devstack sudo[86049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98
Apr 20 17:32:22 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8c210146-f12f-40ba-9348-9204d63d433a tempest-GroupsTest-1143662080 None] Group tempest-Group1-199069181: creating
Apr 20 17:32:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8c210146-f12f-40ba-9348-9204d63d433a tempest-GroupsTest-1143662080 None] Group tempest-Group1-199069181: created successfully
Apr 20 17:32:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8c210146-f12f-40ba-9348-9204d63d433a tempest-GroupsTest-1143662080 None] Create group completed successfully.
Apr 20 17:32:22 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" returned: 0 in 0.528s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4537f99-48ca-47be-952c-e6bb91f6e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b915beec-117a-4cfd-ae47-e2a19d5a5f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:22 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Volume volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 (26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98): created successfully
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b915beec-117a-4cfd-ae47-e2a19d5a5f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Flow 'volume_create_manager' (35ff0147-e78d-420f-ac10-026a03c6a79e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-017b5f42-e2aa-41a1-9c04-c17c1ef33405 tempest-VolumesSnapshotListTestJSON-460425516 None] Created volume successfully.
Apr 20 17:32:23 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61" returned: 0 in 0.978s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_j00pw054devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:32:23 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Converted 112.00 MB image at 112.00 MB/s
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:23 devstack sudo[86068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 1G
Apr 20 17:32:23 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:23 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 1G" returned: 0 in 0.499s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[611058bd-30b6-46de-8e40-22497c63f71b]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:23 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e90b85f1-7016-49c2-8a5a-6ae37c727295 tempest-GroupsTest-1143662080 None] Group tempest-Group2-128891562: creating
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Creating offline snapshot 549f8d79-7916-49a8-848e-568c17f7f105 of volume 26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:32:23 devstack sudo[86073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61
Apr 20 17:32:23 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b49b29-fcf7-4649-91e2-b5303784afcb]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:23 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e90b85f1-7016-49c2-8a5a-6ae37c727295 tempest-GroupsTest-1143662080 None] Group tempest-Group2-128891562: created successfully
Apr 20 17:32:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:23 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e90b85f1-7016-49c2-8a5a-6ae37c727295 tempest-GroupsTest-1143662080 None] Create group completed successfully.
Apr 20 17:32:23 devstack sudo[86076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98
Apr 20 17:32:23 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:24 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" returned: 0 in 0.480s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:24 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61" returned: 0 in 0.575s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:24 devstack sudo[86083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 1G
Apr 20 17:32:24 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:24 devstack sudo[86084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61
Apr 20 17:32:24 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:24 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 1G" returned: 0 in 0.517s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:24 devstack sudo[86093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105
Apr 20 17:32:24 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:24 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61" returned: 1 in 0.550s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Downloaded image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}])) to volume 892daac7-9cec-4ef2-9eea-aa8eccb23c61 successfully. {{(pid=82690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Temporary image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e for user 938acc8fa0dc4b218c0be807ff6a31cf is deleted. {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Marking volume 892daac7-9cec-4ef2-9eea-aa8eccb23c61 as bootable. {{(pid=82690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Copying metadata from image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e to 892daac7-9cec-4ef2-9eea-aa8eccb23c61. {{(pid=82690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Creating volume glance metadata for volume 892daac7-9cec-4ef2-9eea-aa8eccb23c61 backed by image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28784097-afe9-4bac-a688-ea711a5d3706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91bfd21a0>}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee80447-5907-4072-9843-c2adc09c594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:24 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Volume volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 (892daac7-9cec-4ef2-9eea-aa8eccb23c61): created successfully
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee80447-5907-4072-9843-c2adc09c594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Flow 'volume_create_manager' (fe7f0f99-8e4b-4601-9bef-c73391d0267d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:24 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-1e836d43-29ee-465c-9d03-73ea12dfd3fb tempest-VolumesExtendTest-1107464114 None] Created volume successfully.
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Flow 'volume_create_manager' (edeb55fd-2ad3-4da1-9448-9e413faeb901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493a6cc-e446-46eb-84b2-97db4d146f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493a6cc-e446-46eb-84b2-97db4d146f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1410674491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=603396b6-1739-4001-a6a1-3878a164d22f,host='devstack@QuobyteHD#QuobyteHD',id=797365b0-1dbf-40ab-8e16-08da81fb1ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc36d2848d04357babca89171d14203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:25Z,use_quota=True,user_id='90b4d84460a24cbdb02d70fe83ca97d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1955fb5c-e117-4cb2-90e2-c10cb4b4b6a5),volume_type_id=1955fb5c-e117-4cb2-90e2-c10cb4b4b6a5)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4cbe87-da45-42e5-a667-abc5453c0742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4cbe87-da45-42e5-a667-abc5453c0742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5a2d20-c501-41c4-ac68-f45595ce3423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5a2d20-c501-41c4-ac68-f45595ce3423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '797365b0-1dbf-40ab-8e16-08da81fb1ef2', 'volume_name': 'volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda0fcc1-d7e3-4409-9b38-fe6c0ccbc6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda0fcc1-d7e3-4409-9b38-fe6c0ccbc6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb0ddb4-745f-4e56-8077-0de6a9d35253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:25 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Volume 797365b0-1dbf-40ab-8e16-08da81fb1ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2', 'volume_size': 1}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:25 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105" returned: 0 in 0.521s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:25 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 is being set with open permissions: ugo+rw
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:25 devstack sudo[86098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105
Apr 20 17:32:25 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:25 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105" returned: 0 in 0.478s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:25 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.info
Apr 20 17:32:25 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:26 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.info" returned: 0 in 0.488s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:26 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.info is being set with open permissions: ugo+rw
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:26 devstack sudo[86109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.info
Apr 20 17:32:26 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:26 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.info" returned: 0 in 0.533s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.074s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=603396b6-1739-4001-a6a1-3878a164d22f,created_at=2026-04-20T15:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1410674491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=603396b6-1739-4001-a6a1-3878a164d22f,host='devstack@QuobyteHD#QuobyteHD',id=797365b0-1dbf-40ab-8e16-08da81fb1ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc36d2848d04357babca89171d14203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:25Z,use_quota=True,user_id='90b4d84460a24cbdb02d70fe83ca97d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1955fb5c-e117-4cb2-90e2-c10cb4b4b6a5),volume_type_id=1955fb5c-e117-4cb2-90e2-c10cb4b4b6a5)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Creating volume 797365b0-1dbf-40ab-8e16-08da81fb1ef2 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:26 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:26 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-37c8965f-4c75-4d68-a6c9-fb99daa0ba67 tempest-VolumesSnapshotListTestJSON-460425516 None] Create snapshot completed successfully
Apr 20 17:32:26 devstack sudo[86118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2 1073741824
Apr 20 17:32:26 devstack sudo[86118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:27 devstack sudo[86118]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2 1073741824" returned: 0 in 0.522s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:27 devstack sudo[86125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2
Apr 20 17:32:27 devstack sudo[86125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:27 devstack sudo[86125]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2" returned: 0 in 0.417s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.286s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb0ddb4-745f-4e56-8077-0de6a9d35253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435c8303-5445-4aed-902d-6215f0236239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b730c82f-d236-4aee-993f-04e9ccd1ffb2]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:27 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Volume volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2 (797365b0-1dbf-40ab-8e16-08da81fb1ef2): created successfully
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435c8303-5445-4aed-902d-6215f0236239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Flow 'volume_create_manager' (edeb55fd-2ad3-4da1-9448-9e413faeb901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:27 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0b83b58c-dd9a-44f2-8b61-c1b77fe80217 tempest-GroupsTest-1143662080 None] Created volume successfully.
Apr 20 17:32:27 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61
Apr 20 17:32:27 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:28 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61" returned: 0 in 0.563s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:28 devstack sudo[86133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61
Apr 20 17:32:28 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Acquiring lock "cinder-quobyte-797365b0-1dbf-40ab-8e16-08da81fb1ef2" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Lock "cinder-quobyte-797365b0-1dbf-40ab-8e16-08da81fb1ef2" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a2bfa2-24c0-40df-86d2-5ebe0c79034f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:28 devstack sudo[86135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2
Apr 20 17:32:28 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:28 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61" returned: 1 in 0.505s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 2G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 2G" returned: 0 in 0.044s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.156s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.932s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Creating offline snapshot c5bfa6dc-5478-432d-bc9b-58549ca090f5 of volume 26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e72be54-449e-4eba-945c-efbf9be0220e]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:28 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-480a61dc-1ad3-40f1-b4c8-9ce4cc607a0d tempest-VolumesExtendTest-1107464114 None] Extend volume completed successfully.
Apr 20 17:32:29 devstack sudo[86143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105
Apr 20 17:32:29 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:29 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2" returned: 0 in 0.513s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:29 devstack sudo[86148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2
Apr 20 17:32:29 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:29 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105" returned: 0 in 0.514s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:29 devstack sudo[86153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 1G
Apr 20 17:32:29 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:29 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-797365b0-1dbf-40ab-8e16-08da81fb1ef2" returned: 0 in 0.401s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Lock "cinder-quobyte-797365b0-1dbf-40ab-8e16-08da81fb1ef2" released by "delete_volume" :: held 0.935s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Created reservations ['b6c01b71-1b25-4f3e-afd1-75cf7880a7f5'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:29 devstack cinder-volume[82690]: WARNING cinder.quota [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1813950449 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1813950449, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:29 devstack cinder-volume[82690]: WARNING cinder.quota [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1813950449 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1813950449, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Created reservations ['38f81a19-6a70-45c1-ab8f-7bdf8fe55372', 'ec1b0378-342f-4971-8f5f-8ddf3bf67c01', 'f31eaba1-4f48-4b31-82d3-30d330f7f88c', '0a7d3ec2-3698-459a-8640-c985845fedc2'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:29 devstack sudo[86159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:29 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "cinder-892daac7-9cec-4ef2-9eea-aa8eccb23c61-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-892daac7-9cec-4ef2-9eea-aa8eccb23c61-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "cinder-quobyte-892daac7-9cec-4ef2-9eea-aa8eccb23c61" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-quobyte-892daac7-9cec-4ef2-9eea-aa8eccb23c61" acquired by "delete_volume" :: waited 0.021s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae71355b-c3ca-4a0f-ad3d-1bfc3b5c8bd6]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:30 devstack sudo[86161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61
Apr 20 17:32:30 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:30 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 1G" returned: 0 in 0.625s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:30 devstack sudo[86163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5
Apr 20 17:32:30 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:30 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.511s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:30 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:30 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-21a1ccae-044f-4146-99f7-2558477c100b tempest-GroupsTest-1143662080 None] Delete group completed successfully.
Apr 20 17:32:30 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:30 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5" returned: 0 in 0.452s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:30 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 is being set with open permissions: ugo+rw
Apr 20 17:32:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:30 devstack sudo[86171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61
Apr 20 17:32:30 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:30 devstack sudo[86172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5
Apr 20 17:32:30 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] Created reservations ['1d77f685-7fee-4c8f-82b0-93a4e22cc027'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:31 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61" returned: 1 in 0.582s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:31 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:31 devstack sudo[86179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61
Apr 20 17:32:31 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5" returned: 0 in 0.548s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:31 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6829da49-dee4-4d98-9123-a060aee7837c tempest-VolumesSnapshotListTestJSON-460425516 None] Create snapshot completed successfully
Apr 20 17:32:31 devstack sudo[86181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:31 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:31 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-892daac7-9cec-4ef2-9eea-aa8eccb23c61" returned: 0 in 0.466s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-quobyte-892daac7-9cec-4ef2-9eea-aa8eccb23c61" released by "delete_volume" :: held 1.570s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Created reservations ['aa85e14b-683b-405e-80de-75c05ebf1a0a', 'd004b4f6-1c02-490d-850c-985a3311dd79', 'dd53baa1-c6c8-45bd-9019-ad03a6d137e6', '9c96145f-0f8a-4f17-83c7-e914060bac46'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:31 devstack sudo[86185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:31 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:31 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.506s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:31 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:31 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-85956c94-7fa8-417d-8844-66d57311df2d tempest-GroupsTest-1143662080 None] Delete group completed successfully.
Apr 20 17:32:32 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.460s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:32 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Deleted volume successfully.
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25829713-5b4b-461b-b93b-a9a834877d06 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-892daac7-9cec-4ef2-9eea-aa8eccb23c61-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Creating offline snapshot 2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d of volume 26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a35c01-c9a5-4da6-a49f-0087123dcb53]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Flow 'volume_create_manager' (75e85908-b99f-4651-a843-211debbe7a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b659864f-6ba0-485e-b350-9b53cc7819b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:32 devstack sudo[86190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5
Apr 20 17:32:32 devstack sudo[86190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b659864f-6ba0-485e-b350-9b53cc7819b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-101704910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969d5de9-32e8-45a2-82bf-88c941a89c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b37f2fa0f2a41299b9c406c7edd270b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:32Z,use_quota=True,user_id='938acc8fa0dc4b218c0be807ff6a31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb18838-f94c-47da-bd2f-727ac2bb7d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb18838-f94c-47da-bd2f-727ac2bb7d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c358f0-0d98-4c1a-bcd7-bcf0593a4e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5c358f0-0d98-4c1a-bcd7-bcf0593a4e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969d5de9-32e8-45a2-82bf-88c941a89c64', 'volume_name': 'volume-969d5de9-32e8-45a2-82bf-88c941a89c64', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa76aa28-43a7-41f9-a75f-455ce03f6c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa76aa28-43a7-41f9-a75f-455ce03f6c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdd128b-44ab-4fae-a29b-c32be97c624a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:32 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Volume 969d5de9-32e8-45a2-82bf-88c941a89c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969d5de9-32e8-45a2-82bf-88c941a89c64', 'volume_size': 1}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:32 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f9e1a503-6a8f-421e-a2cd-0b6e47c728bc tempest-GroupsTest-1143662080 None] Group tempest-GroupsTest-Group-1195592153: creating
Apr 20 17:32:32 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f9e1a503-6a8f-421e-a2cd-0b6e47c728bc tempest-GroupsTest-1143662080 None] Group tempest-GroupsTest-Group-1195592153: created successfully
Apr 20 17:32:32 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f9e1a503-6a8f-421e-a2cd-0b6e47c728bc tempest-GroupsTest-1143662080 None] Create group completed successfully.
Apr 20 17:32:32 devstack sudo[86190]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5" returned: 0 in 0.535s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:32:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:32 devstack sudo[86208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d 1G
Apr 20 17:32:32 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:33 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d 1G" returned: 0 in 0.628s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:33 devstack sudo[86215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d
Apr 20 17:32:33 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:34 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d" returned: 0 in 0.577s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:34 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d is being set with open permissions: ugo+rw
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:34 devstack sudo[86222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d
Apr 20 17:32:34 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Flow 'volume_create_manager' (732d61e2-8a80-4c8f-8b12-946628e48aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf940aa-5b79-44d2-941d-a7d30bdcc6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf940aa-5b79-44d2-941d-a7d30bdcc6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270618328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55ffc2e9-932c-4439-8c42-cd421b758ff4,host='devstack@QuobyteHD#QuobyteHD',id=c2829637-58b3-449b-a7fd-0a315604b142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc36d2848d04357babca89171d14203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:34Z,use_quota=True,user_id='90b4d84460a24cbdb02d70fe83ca97d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb4598b-c7ab-41a5-9353-970a24f7ef99),volume_type_id=6eb4598b-c7ab-41a5-9353-970a24f7ef99)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a80b164-b5f6-4f24-98fb-3910b9199583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a80b164-b5f6-4f24-98fb-3910b9199583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29897469-a82d-478b-9253-8408abcdb4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29897469-a82d-478b-9253-8408abcdb4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2829637-58b3-449b-a7fd-0a315604b142', 'volume_name': 'volume-c2829637-58b3-449b-a7fd-0a315604b142', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb2c149-abc4-44b5-9af4-5b453917135d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb2c149-abc4-44b5-9af4-5b453917135d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6501a4fb-7c3d-412c-a67d-61ab296e34d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:34 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Volume c2829637-58b3-449b-a7fd-0a315604b142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2829637-58b3-449b-a7fd-0a315604b142', 'volume_size': 1}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:34 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d" returned: 0 in 0.503s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.178s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-101704910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969d5de9-32e8-45a2-82bf-88c941a89c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b37f2fa0f2a41299b9c406c7edd270b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:32Z,use_quota=True,user_id='938acc8fa0dc4b218c0be807ff6a31cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Creating volume 969d5de9-32e8-45a2-82bf-88c941a89c64 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:34 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:34 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-787290c3-45e0-468f-a38a-a1fca1b8bc63 tempest-VolumesSnapshotListTestJSON-460425516 None] Create snapshot completed successfully
Apr 20 17:32:34 devstack sudo[86228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64 1073741824
Apr 20 17:32:34 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:35 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64 1073741824" returned: 0 in 0.503s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:35 devstack sudo[86247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64
Apr 20 17:32:35 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:35 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64" returned: 0 in 0.485s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=55ffc2e9-932c-4439-8c42-cd421b758ff4,created_at=2026-04-20T15:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270618328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55ffc2e9-932c-4439-8c42-cd421b758ff4,host='devstack@QuobyteHD#QuobyteHD',id=c2829637-58b3-449b-a7fd-0a315604b142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc36d2848d04357babca89171d14203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:34Z,use_quota=True,user_id='90b4d84460a24cbdb02d70fe83ca97d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb4598b-c7ab-41a5-9353-970a24f7ef99),volume_type_id=6eb4598b-c7ab-41a5-9353-970a24f7ef99)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Creating volume c2829637-58b3-449b-a7fd-0a315604b142 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:35 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdd128b-44ab-4fae-a29b-c32be97c624a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969d5de9-32e8-45a2-82bf-88c941a89c64', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:35 devstack sudo[86253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142 1073741824
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa118b9-decc-4142-8650-b22d4ec80a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:35 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:35 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Volume volume-969d5de9-32e8-45a2-82bf-88c941a89c64 (969d5de9-32e8-45a2-82bf-88c941a89c64): created successfully
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa118b9-decc-4142-8650-b22d4ec80a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Flow 'volume_create_manager' (75e85908-b99f-4651-a843-211debbe7a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-32471fcc-9929-4d78-a329-518e38bd1db5 tempest-VolumesExtendTest-1107464114 None] Created volume successfully.
Apr 20 17:32:36 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142 1073741824" returned: 0 in 0.549s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:36 devstack sudo[86259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:36 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-quobyte-2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Deleting offline snapshot 2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d of volume 26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] snapshot_file for this snap is: volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[339659c6-d6fc-4488-83cb-50d6ad3f3ad5]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:36 devstack sudo[86261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d
Apr 20 17:32:36 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:36 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142" returned: 0 in 0.434s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6501a4fb-7c3d-412c-a67d-61ab296e34d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2829637-58b3-449b-a7fd-0a315604b142', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cbc725-9c8e-4dbf-8612-06f957bb115a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:36 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Volume volume-c2829637-58b3-449b-a7fd-0a315604b142 (c2829637-58b3-449b-a7fd-0a315604b142): created successfully
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cbc725-9c8e-4dbf-8612-06f957bb115a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Flow 'volume_create_manager' (732d61e2-8a80-4c8f-8b12-946628e48aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:36 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-25726a12-76d2-4b35-98a3-a9b59d1e2407 tempest-GroupsTest-1143662080 None] Created volume successfully.
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Creating offline snapshot cd968923-d533-4d53-81b6-b4622bc21bdf of volume 969d5de9-32e8-45a2-82bf-88c941a89c64 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[232ce745-d9da-4f9c-9820-33f57ba1ce3a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:36 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d" returned: 0 in 0.529s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7ef81b-7367-4efb-9044-722dd6cf15b3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:36 devstack sudo[86267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64
Apr 20 17:32:36 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:37 devstack sudo[86292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5
Apr 20 17:32:37 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:37 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5" returned: 0 in 0.744s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:37 devstack sudo[86308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d
Apr 20 17:32:37 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:37 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64" returned: 0 in 0.921s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:37 devstack sudo[86310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf 1G
Apr 20 17:32:37 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Flow 'volume_create_manager' (fcd5fce0-dee9-451a-a86c-64d40772b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb0435d-1a53-4c61-bc54-84650d958ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb0435d-1a53-4c61-bc54-84650d958ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066342627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55ffc2e9-932c-4439-8c42-cd421b758ff4,host='devstack@QuobyteHD#QuobyteHD',id=b94419d8-7d25-4286-ab35-84674cd03c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc36d2848d04357babca89171d14203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:38Z,use_quota=True,user_id='90b4d84460a24cbdb02d70fe83ca97d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb4598b-c7ab-41a5-9353-970a24f7ef99),volume_type_id=6eb4598b-c7ab-41a5-9353-970a24f7ef99)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe60e5f-abb3-486e-a2df-bd30b9c9f186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe60e5f-abb3-486e-a2df-bd30b9c9f186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac91fe41-545d-4485-93a8-7ac54528d46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac91fe41-545d-4485-93a8-7ac54528d46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94419d8-7d25-4286-ab35-84674cd03c69', 'volume_name': 'volume-b94419d8-7d25-4286-ab35-84674cd03c69', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b048e9-861c-439f-b89b-675a2524b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b048e9-861c-439f-b89b-675a2524b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810b791e-ba43-4b3d-a18c-abfa5cd06e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:37 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Volume b94419d8-7d25-4286-ab35-84674cd03c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94419d8-7d25-4286-ab35-84674cd03c69', 'volume_size': 1}
Apr 20 17:32:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:38 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d" returned: 0 in 0.615s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:38 devstack sudo[86318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d
Apr 20 17:32:38 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:38 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf 1G" returned: 0 in 0.651s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969d5de9-32e8-45a2-82bf-88c941a89c64 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:38 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969d5de9-32e8-45a2-82bf-88c941a89c64 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf
Apr 20 17:32:38 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:39 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d" returned: 0 in 0.812s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d" released by "_delete_snapshot" :: held 2.820s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" released by "delete_snapshot" :: held 2.839s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Created reservations ['e9e5a60f-b771-466b-ae3b-a22b8d3026bd', '98bfde3a-547c-4837-99c0-2206ed2bdfa6', '3323ee88-7eb7-4d82-92f7-2c2f31d21b54', '9702ffe6-8a3d-4d88-8a71-7bbdc9f018c8'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:39 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:39 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Delete snapshot completed successfully.
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969d5de9-32e8-45a2-82bf-88c941a89c64 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf" returned: 0 in 0.929s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:39 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf is being set with open permissions: ugo+rw
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-efb50a32-83f5-42b2-9a49-8a7957c72821 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-2ae3a88e-7b16-4ac4-a5a5-de5ebdcb671d-delete_snapshot" released by "delete_snapshot" :: held 3.013s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:39 devstack sudo[86353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf
Apr 20 17:32:39 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-c5bfa6dc-5478-432d-bc9b-58549ca090f5-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-c5bfa6dc-5478-432d-bc9b-58549ca090f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-quobyte-c5bfa6dc-5478-432d-bc9b-58549ca090f5" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-c5bfa6dc-5478-432d-bc9b-58549ca090f5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Deleting offline snapshot c5bfa6dc-5478-432d-bc9b-58549ca090f5 of volume 26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] snapshot_file for this snap is: volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fed715-c97b-4dab-b58e-a0a083ff69e3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:39 devstack sudo[86356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5
Apr 20 17:32:39 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:39 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf" returned: 0 in 0.518s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:39 devstack sudo[86359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.info
Apr 20 17:32:39 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:40 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5" returned: 0 in 0.736s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[818b2b82-dbba-422c-94fa-53e7031947ce]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:40 devstack sudo[86364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105
Apr 20 17:32:40 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:40 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.info" returned: 0 in 0.556s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:40 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.info is being set with open permissions: ugo+rw
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:40 devstack sudo[86367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.info
Apr 20 17:32:40 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:40 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105" returned: 0 in 0.577s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:40 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.info" returned: 0 in 0.458s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:40 devstack sudo[86373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5
Apr 20 17:32:40 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.097s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.902s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=55ffc2e9-932c-4439-8c42-cd421b758ff4,created_at=2026-04-20T15:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2066342627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=55ffc2e9-932c-4439-8c42-cd421b758ff4,host='devstack@QuobyteHD#QuobyteHD',id=b94419d8-7d25-4286-ab35-84674cd03c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc36d2848d04357babca89171d14203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:38Z,use_quota=True,user_id='90b4d84460a24cbdb02d70fe83ca97d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6eb4598b-c7ab-41a5-9353-970a24f7ef99),volume_type_id=6eb4598b-c7ab-41a5-9353-970a24f7ef99)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Creating volume b94419d8-7d25-4286-ab35-84674cd03c69 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:40 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:40 devstack sudo[86375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69 1073741824
Apr 20 17:32:40 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:40 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a989c977-3efc-4878-aa8b-89adafffef75 tempest-VolumesExtendTest-1107464114 None] Create snapshot completed successfully
Apr 20 17:32:41 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5" returned: 0 in 0.844s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:41 devstack sudo[86385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5
Apr 20 17:32:41 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:41 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69 1073741824" returned: 0 in 0.873s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:41 devstack sudo[86387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69
Apr 20 17:32:41 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-59fd5184-efb2-4807-95c7-78bef2b63bcd tempest-VolumesExtendTest-1107464114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:42 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.c5bfa6dc-5478-432d-bc9b-58549ca090f5" returned: 0 in 0.499s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-c5bfa6dc-5478-432d-bc9b-58549ca090f5" released by "_delete_snapshot" :: held 2.768s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" released by "delete_snapshot" :: held 2.793s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Created reservations ['041e70f3-ac5a-45e9-95a2-a067f64f196a', '679a5d0e-c0f9-45e9-90d8-8fa810d4768d', 'dd484122-b828-4c27-a0f1-3933c8c1bb60', '2e0fa438-8e49-4913-aac5-577a1a79803f'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Delete snapshot completed successfully.
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01e43cb-59b4-4b4f-a94d-2cd3ab4d0dd9 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-c5bfa6dc-5478-432d-bc9b-58549ca090f5-delete_snapshot" released by "delete_snapshot" :: held 2.882s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:42 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69" returned: 0 in 0.537s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-59fd5184-efb2-4807-95c7-78bef2b63bcd tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.159s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810b791e-ba43-4b3d-a18c-abfa5cd06e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94419d8-7d25-4286-ab35-84674cd03c69', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97d8530-99fe-459b-805e-32030321fa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c87897-5937-4f83-a35b-147582a92fc7]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-59fd5184-efb2-4807-95c7-78bef2b63bcd tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:42 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Volume volume-b94419d8-7d25-4286-ab35-84674cd03c69 (b94419d8-7d25-4286-ab35-84674cd03c69): created successfully
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97d8530-99fe-459b-805e-32030321fa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Flow 'volume_create_manager' (fcd5fce0-dee9-451a-a86c-64d40772b380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-112063cd-d9c2-4c0e-8eaa-30f0b617abc4 tempest-GroupsTest-1143662080 None] Created volume successfully.
Apr 20 17:32:42 devstack sudo[86391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64
Apr 20 17:32:42 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-549f8d79-7916-49a8-848e-568c17f7f105-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-549f8d79-7916-49a8-848e-568c17f7f105-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-quobyte-549f8d79-7916-49a8-848e-568c17f7f105" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-549f8d79-7916-49a8-848e-568c17f7f105" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Deleting offline snapshot 549f8d79-7916-49a8-848e-568c17f7f105 of volume 26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] snapshot_file for this snap is: volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8867b52-cee8-4196-ba12-0fbfc7541cfd]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:43 devstack sudo[86395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105
Apr 20 17:32:43 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:43 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-59fd5184-efb2-4807-95c7-78bef2b63bcd tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64" returned: 0 in 0.858s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-59fd5184-efb2-4807-95c7-78bef2b63bcd tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf 2G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:43 devstack sudo[86402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:43 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-59fd5184-efb2-4807-95c7-78bef2b63bcd tempest-VolumesExtendTest-1107464114 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf 2G" returned: 0 in 0.227s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-59fd5184-efb2-4807-95c7-78bef2b63bcd tempest-VolumesExtendTest-1107464114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.143s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:43 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-59fd5184-efb2-4807-95c7-78bef2b63bcd tempest-VolumesExtendTest-1107464114 None] Extend volume completed successfully.
Apr 20 17:32:43 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105" returned: 0 in 0.705s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd62609-dcc3-4139-9ac3-83e1aff4a205]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:43 devstack sudo[86408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98
Apr 20 17:32:43 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:43 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9570771f-5f62-4d44-b2ac-52b709595c15 tempest-GroupsTest-1143662080 None] Update group completed successfully.
Apr 20 17:32:43 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.657s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:44 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" returned: 0 in 0.668s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:44 devstack sudo[86414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105
Apr 20 17:32:44 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "cinder-cd968923-d533-4d53-81b6-b4622bc21bdf-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-cd968923-d533-4d53-81b6-b4622bc21bdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "cinder-quobyte-969d5de9-32e8-45a2-82bf-88c941a89c64" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-quobyte-969d5de9-32e8-45a2-82bf-88c941a89c64" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "cinder-quobyte-cd968923-d533-4d53-81b6-b4622bc21bdf" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-quobyte-cd968923-d533-4d53-81b6-b4622bc21bdf" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Deleting offline snapshot cd968923-d533-4d53-81b6-b4622bc21bdf of volume 969d5de9-32e8-45a2-82bf-88c941a89c64 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] snapshot_file for this snap is: volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f4121-bdfa-4a14-ba4d-504a5a9bea55]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:44 devstack sudo[86416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf
Apr 20 17:32:44 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:44 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105" returned: 0 in 0.577s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:44 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105
Apr 20 17:32:44 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:45 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf" returned: 0 in 0.618s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-969d5de9-32e8-45a2-82bf-88c941a89c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5fa078-014d-4d66-b459-d0575123af6e]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:45 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-acd3f923-3423-4465-abd8-4f4177febd2d tempest-GroupsTest-1143662080 None] Update group completed successfully.
Apr 20 17:32:45 devstack sudo[86426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64
Apr 20 17:32:45 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:45 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98.549f8d79-7916-49a8-848e-568c17f7f105" returned: 0 in 0.634s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-549f8d79-7916-49a8-848e-568c17f7f105" released by "_delete_snapshot" :: held 2.772s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" released by "delete_snapshot" :: held 2.814s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Created reservations ['150ba574-42b1-4486-880c-159899a65809', '2b112232-8362-4c23-8409-b767dca4655e', 'c23758c7-2b98-4d24-b8ec-0913664d49ee', 'f9647873-e142-450d-a2dd-8159c30fceea'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:45 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Delete snapshot completed successfully.
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f0651bd-58c7-4c72-a050-bbdf2cb239ca tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-549f8d79-7916-49a8-848e-568c17f7f105-delete_snapshot" released by "delete_snapshot" :: held 2.971s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:45 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64" returned: 0 in 0.681s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:45 devstack sudo[86456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf
Apr 20 17:32:45 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20f71fa-ae4c-48cd-8e9f-dcbd6da112df]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:46 devstack sudo[86459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98
Apr 20 17:32:46 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Acquiring lock "cinder-quobyte-b94419d8-7d25-4286-ab35-84674cd03c69" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:46 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf" returned: 0 in 0.705s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Lock "cinder-quobyte-b94419d8-7d25-4286-ab35-84674cd03c69" acquired by "delete_volume" :: waited 0.045s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd436fa-eb66-4eb6-97e1-4e18ff6142b3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:46 devstack sudo[86465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf
Apr 20 17:32:46 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:46 devstack sudo[86466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69
Apr 20 17:32:46 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:46 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" returned: 0 in 0.746s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:46 devstack sudo[86477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98
Apr 20 17:32:46 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:47 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64.cd968923-d533-4d53-81b6-b4622bc21bdf" returned: 0 in 0.599s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:47 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69" returned: 0 in 0.583s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-quobyte-cd968923-d533-4d53-81b6-b4622bc21bdf" released by "_delete_snapshot" :: held 2.679s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-quobyte-969d5de9-32e8-45a2-82bf-88c941a89c64" released by "delete_snapshot" :: held 2.694s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:47 devstack sudo[86483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69
Apr 20 17:32:47 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Created reservations ['56b4308c-8e3f-42ad-b399-f4f91a724e4b', 'f3523344-ba8d-4fab-a55a-d11e7e384d2b', '5f073026-0b9e-4464-ae7b-fd3ce2a7ba79', '94d597a5-845e-497e-9f9b-f6033ce7513d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:47 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Delete snapshot completed successfully.
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9027d21f-5ea8-47a3-8c79-694d73192fa2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-cd968923-d533-4d53-81b6-b4622bc21bdf-delete_snapshot" released by "delete_snapshot" :: held 2.835s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:47 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" returned: 0 in 0.519s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-quobyte-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98" released by "delete_volume" :: held 1.369s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Created reservations ['a53afb5d-5de1-42d0-9ae1-d98b0f4bcdcf', 'e183f404-b6ac-42bb-bf57-8b9dbbe908e5', 'cd8473eb-da07-4275-9e17-19d6b4baeff9', 'a21623c3-1c0c-4879-be41-ee39d21fa829'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:47 devstack sudo[86486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:47 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:47 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b94419d8-7d25-4286-ab35-84674cd03c69" returned: 0 in 0.456s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Lock "cinder-quobyte-b94419d8-7d25-4286-ab35-84674cd03c69" released by "delete_volume" :: held 1.066s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Acquiring lock "cinder-quobyte-c2829637-58b3-449b-a7fd-0a315604b142" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Lock "cinder-quobyte-c2829637-58b3-449b-a7fd-0a315604b142" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[22878e90-5080-4419-8b3b-003434a2caf2]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "cinder-969d5de9-32e8-45a2-82bf-88c941a89c64-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-969d5de9-32e8-45a2-82bf-88c941a89c64-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "cinder-quobyte-969d5de9-32e8-45a2-82bf-88c941a89c64" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-quobyte-969d5de9-32e8-45a2-82bf-88c941a89c64" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:32:47 devstack sudo[86490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142
Apr 20 17:32:47 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[941952b8-d480-44e5-bafe-a90a89e87e6b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:47 devstack sudo[86492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64
Apr 20 17:32:47 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:47 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.544s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:47 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:47 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Deleted volume successfully.
Apr 20 17:32:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f5761d1-8c71-4d4d-a2c6-124080d01f12 tempest-VolumesSnapshotListTestJSON-460425516 None] Lock "cinder-26ae13ae-a0b5-4dc0-b2dd-ea1d9ab53d98-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:48 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142" returned: 0 in 0.705s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:48 devstack sudo[86501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142
Apr 20 17:32:48 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:48 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64" returned: 0 in 0.649s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:48 devstack sudo[86503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64
Apr 20 17:32:48 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:48 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c2829637-58b3-449b-a7fd-0a315604b142" returned: 0 in 0.595s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Lock "cinder-quobyte-c2829637-58b3-449b-a7fd-0a315604b142" released by "delete_volume" :: held 1.333s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:49 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-969d5de9-32e8-45a2-82bf-88c941a89c64" returned: 0 in 0.552s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Created reservations ['516434a0-3f2f-4d1d-85fd-d5504e44ed58'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-quobyte-969d5de9-32e8-45a2-82bf-88c941a89c64" released by "delete_volume" :: held 1.236s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:49 devstack cinder-volume[82690]: WARNING cinder.quota [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1402278844 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1402278844, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:49 devstack cinder-volume[82690]: WARNING cinder.quota [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1402278844 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1402278844, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Created reservations ['69b1e2b6-a716-4689-9be2-b432e5d33d57', '38efa507-c4f4-4217-9872-eb7806bcb7eb', '451ee1c1-0c7a-4bff-85de-0145d69c0d5a', '1f00addc-3567-474a-93e1-1a871add7c59'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Created reservations ['405e7fed-71f0-4d58-ae6c-ef7f69dd6bee', '4635e5c9-d1e0-4e9d-b73c-3daa98443d82', 'b2e3e61f-af56-4e3d-904a-0eda77dbcf6f', '195edac0-dcf9-4234-979d-46840de59de9'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Created reservations ['971bf620-2b75-483d-b93b-2b77dd470760', '3f203ca3-c083-40b4-ba30-4ab8f3ddcc5e', 'd0df48cf-c249-4bd0-83c0-c01485c45369', 'bf11df7d-e710-47b8-8519-ff205ba7ac8d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:32:49 devstack sudo[86508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:49 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:49 devstack sudo[86510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:32:49 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:49 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.577s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:49 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Deleted volume successfully.
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9d64fd54-d23d-4635-bf59-c527786de0b2 tempest-VolumesExtendTest-1107464114 None] Lock "cinder-969d5de9-32e8-45a2-82bf-88c941a89c64-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:32:49 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.527s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:49 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:32:49 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c31a438b-8448-4dfb-a6e9-e68c235fba35 tempest-GroupsTest-1143662080 None] Delete group completed successfully.
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=224,cinder:INSERT=72,cinder:UPDATE=254,cinder:DELETE=13 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=197,cinder:INSERT=55,cinder:UPDATE=226,cinder:DELETE=13 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Flow 'volume_create_manager' (682102a3-c70a-40eb-844d-4dbd0e02b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d890fdc-98ce-4d32-8b2c-e1829edc3bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d890fdc-98ce-4d32-8b2c-e1829edc3bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1265785041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f795e0f8-cceb-47ec-94b8-04d58259ad3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734176792f546b4b8b6e575e421f469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:51Z,use_quota=True,user_id='ee0628178d0145fc871064f4709429b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f528ee-4b02-49e5-b643-ac03619eca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f528ee-4b02-49e5-b643-ac03619eca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8700f145-be78-4ae8-9382-04456af18e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8700f145-be78-4ae8-9382-04456af18e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f795e0f8-cceb-47ec-94b8-04d58259ad3b', 'volume_name': 'volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b', 'volume_size': 2}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf22b71-47cb-4c5b-9566-a96cdf6d901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf22b71-47cb-4c5b-9566-a96cdf6d901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9d6ef9-9217-4099-9e9e-a8297dae8b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:51 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Volume f795e0f8-cceb-47ec-94b8-04d58259ad3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b', 'volume_size': 2}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1265785041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f795e0f8-cceb-47ec-94b8-04d58259ad3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1734176792f546b4b8b6e575e421f469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:51Z,use_quota=True,user_id='ee0628178d0145fc871064f4709429b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Creating volume f795e0f8-cceb-47ec-94b8-04d58259ad3b {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:51 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b 2147483648 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:51 devstack sudo[86543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b 2147483648
Apr 20 17:32:51 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Flow 'volume_create_manager' (51fb9b63-ccc0-4dc5-8639-346ec2245cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f04318-c718-4416-ae60-d361d25758e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f04318-c718-4416-ae60-d361d25758e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1841353594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d20f55-6f6a-4376-ac6d-cda74e9e379a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0cfb3996684ffd9414a1e58aa5e566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:53Z,use_quota=True,user_id='e61828a80b574977b6f2abd5b438686e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe098990-2433-4d1a-874e-c5a70474a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe098990-2433-4d1a-874e-c5a70474a19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fde17ce-26e7-4bd4-be6f-ad303954a15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fde17ce-26e7-4bd4-be6f-ad303954a15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d20f55-6f6a-4376-ac6d-cda74e9e379a', 'volume_name': 'volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda236ad-71a8-4acc-8301-b96d4c50fded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda236ad-71a8-4acc-8301-b96d4c50fded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00bf1b8-72e4-49d0-a12c-3f5a94096e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:53 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Volume c8d20f55-6f6a-4376-ac6d-cda74e9e379a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a', 'volume_size': 1}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:53 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b 2147483648" returned: 0 in 1.893s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:53 devstack sudo[86550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b
Apr 20 17:32:53 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (778c69a7-7cbe-4f2a-afba-94edfcd6e9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b24411-1895-4831-afff-d865d2617dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b24411-1895-4831-afff-d865d2617dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-204564647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c6943b-e50c-48d5-9bb3-5d4596bf08f4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:54Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcfebf75-ccfd-449f-839e-46ef5d99d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcfebf75-ccfd-449f-839e-46ef5d99d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80626c17-9095-429d-b4cf-fcab3b3319ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80626c17-9095-429d-b4cf-fcab3b3319ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c6943b-e50c-48d5-9bb3-5d4596bf08f4', 'volume_name': 'volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e886739d-4903-4d3d-be2f-cb95a61835eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e886739d-4903-4d3d-be2f-cb95a61835eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a41d5f-5fc9-4eec-ab97-890e48d59241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:54 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Volume 43c6943b-e50c-48d5-9bb3-5d4596bf08f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4', 'volume_size': 1}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:54 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b" returned: 0 in 0.719s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.669s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.798s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1841353594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d20f55-6f6a-4376-ac6d-cda74e9e379a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f0cfb3996684ffd9414a1e58aa5e566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:53Z,use_quota=True,user_id='e61828a80b574977b6f2abd5b438686e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Creating volume c8d20f55-6f6a-4376-ac6d-cda74e9e379a {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:54 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9d6ef9-9217-4099-9e9e-a8297dae8b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b', 'volume_size': 2}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf58b6e0-2900-4b45-bffd-48ffc18bb519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:54 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Volume volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b (f795e0f8-cceb-47ec-94b8-04d58259ad3b): created successfully
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf58b6e0-2900-4b45-bffd-48ffc18bb519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:54 devstack sudo[86553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a 1073741824
Apr 20 17:32:54 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Flow 'volume_create_manager' (682102a3-c70a-40eb-844d-4dbd0e02b493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:54 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-da691162-5f3d-4067-90bb-a031cd5022b7 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Created volume successfully.
Apr 20 17:32:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:55 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a 1073741824" returned: 0 in 1.073s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:55 devstack sudo[86564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a
Apr 20 17:32:55 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:55 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a" returned: 0 in 0.504s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.656s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-204564647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c6943b-e50c-48d5-9bb3-5d4596bf08f4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:54Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Creating volume 43c6943b-e50c-48d5-9bb3-5d4596bf08f4 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:32:55 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00bf1b8-72e4-49d0-a12c-3f5a94096e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3615fa3f-4060-4031-b39d-e772992d3f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:55 devstack sudo[86567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4 1073741824
Apr 20 17:32:55 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:55 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Volume volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a (c8d20f55-6f6a-4376-ac6d-cda74e9e379a): created successfully
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3615fa3f-4060-4031-b39d-e772992d3f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Flow 'volume_create_manager' (51fb9b63-ccc0-4dc5-8639-346ec2245cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-2d4cbfb7-7ae2-46e7-b797-1a6d843b108a tempest-ServerRescueNegativeTestJSON-105297650 None] Created volume successfully.
Apr 20 17:32:56 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4 1073741824" returned: 0 in 0.556s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:56 devstack sudo[86574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4
Apr 20 17:32:56 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:56 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4" returned: 0 in 0.587s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:32:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:32:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.351s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:32:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a41d5f-5fc9-4eec-ab97-890e48d59241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912f0208-9a0a-44d8-9770-0a32b7babc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:56 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Volume volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4 (43c6943b-e50c-48d5-9bb3-5d4596bf08f4): created successfully
Apr 20 17:32:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912f0208-9a0a-44d8-9770-0a32b7babc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:57 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (778c69a7-7cbe-4f2a-afba-94edfcd6e9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Creating offline snapshot e7bec592-ce09-4e79-bbb7-31b032799277 of volume f795e0f8-cceb-47ec-94b8-04d58259ad3b {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:32:57 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8ea81c98-1158-4100-be4a-c25e93d09f47 tempest-VolumesGetTest-992452388 None] Created volume successfully.
Apr 20 17:32:57 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[84306932-0f7e-4b28-be5a-f0602b4d1be1]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:32:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:57 devstack sudo[86578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b
Apr 20 17:32:57 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:57 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b" returned: 0 in 0.770s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 2G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:57 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 2G
Apr 20 17:32:57 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (db7b0d14-2ba5-470c-94cf-f12498bcbf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d2a067-05f3-4bf8-a4df-27ca0f8bf07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d2a067-05f3-4bf8-a4df-27ca0f8bf07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2011079056',display_name='tempest-VolumesGetTest-Volume-1275179690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6508439c-211a-4800-b555-55309d88f049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:58Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e251cdac-468f-4aeb-8900-079b3dcf152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e251cdac-468f-4aeb-8900-079b3dcf152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f10e55-8253-4bd2-9ea3-dd4b020fa179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f10e55-8253-4bd2-9ea3-dd4b020fa179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6508439c-211a-4800-b555-55309d88f049', 'volume_name': 'volume-6508439c-211a-4800-b555-55309d88f049', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0a8542-810e-4a29-8f22-901af738e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0a8542-810e-4a29-8f22-901af738e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c997d7ca-c146-451d-9461-9c829d3e47cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:32:58 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Volume 6508439c-211a-4800-b555-55309d88f049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6508439c-211a-4800-b555-55309d88f049', 'volume_size': 1}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:32:58 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 2G" returned: 0 in 0.925s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:58 devstack sudo[86588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277
Apr 20 17:32:58 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:32:59 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root
Apr 20 17:32:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277" returned: 0 in 0.737s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:32:59 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 is being set with open permissions: ugo+rw
Apr 20 17:32:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:32:59 devstack sudo[86594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277
Apr 20 17:32:59 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:00 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277" returned: 0 in 0.566s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:00 devstack sudo[86599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.info
Apr 20 17:33:00 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:00 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.info" returned: 0 in 0.508s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:00 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.info is being set with open permissions: ugo+rw
Apr 20 17:33:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:00 devstack sudo[86626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.info
Apr 20 17:33:00 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:01 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.info" returned: 0 in 0.576s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.178s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.948s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:32:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2011079056',display_name='tempest-VolumesGetTest-Volume-1275179690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6508439c-211a-4800-b555-55309d88f049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:32:58Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Creating volume 6508439c-211a-4800-b555-55309d88f049 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:01 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:01 devstack sudo[86630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049 1073741824
Apr 20 17:33:01 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-1732461d-2903-41c7-a359-c91713bc527e tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Create snapshot completed successfully
Apr 20 17:33:01 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:01 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049 1073741824" returned: 0 in 0.758s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:01 devstack sudo[86675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049
Apr 20 17:33:01 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Acquiring lock "cinder-e7bec592-ce09-4e79-bbb7-31b032799277-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-e7bec592-ce09-4e79-bbb7-31b032799277-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Acquiring lock "cinder-quobyte-f795e0f8-cceb-47ec-94b8-04d58259ad3b" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-quobyte-f795e0f8-cceb-47ec-94b8-04d58259ad3b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Acquiring lock "cinder-quobyte-e7bec592-ce09-4e79-bbb7-31b032799277" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-quobyte-e7bec592-ce09-4e79-bbb7-31b032799277" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Deleting offline snapshot e7bec592-ce09-4e79-bbb7-31b032799277 of volume f795e0f8-cceb-47ec-94b8-04d58259ad3b {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] snapshot_file for this snap is: volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fbb727-e66d-4c0f-803a-866de7c44650]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:02 devstack sudo[86677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277
Apr 20 17:33:02 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:02 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049" returned: 0 in 0.583s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c997d7ca-c146-451d-9461-9c829d3e47cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6508439c-211a-4800-b555-55309d88f049', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a25eb2-51c0-4561-9b12-d67ae8a01472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:02 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Volume volume-6508439c-211a-4800-b555-55309d88f049 (6508439c-211a-4800-b555-55309d88f049): created successfully
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a25eb2-51c0-4561-9b12-d67ae8a01472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (db7b0d14-2ba5-470c-94cf-f12498bcbf6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:02 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3235a5af-9b1c-49a6-a96c-f6a656fb12da tempest-VolumesGetTest-992452388 None] Created volume successfully.
Apr 20 17:33:02 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277" returned: 0 in 0.651s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[35302b9b-4981-49d7-88bf-582704162cef]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:02 devstack sudo[86684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b
Apr 20 17:33:02 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:02 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Flow 'volume_create_manager' (5e8560e4-301a-477c-8d51-efe1fdb90b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0d6439-c48c-4e93-99fe-118a7952663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0d6439-c48c-4e93-99fe-118a7952663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1159628083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b344564-ed16-42a6-837f-4791c821fc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b809da00a4445e6b2e586b116730dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:03Z,use_quota=True,user_id='d82877b8c3c84bd3a4127bac56db79d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d311ac9-843a-4bfa-b74c-320e4ce240b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d311ac9-843a-4bfa-b74c-320e4ce240b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bc13c5-a448-42df-b33b-cacea0bf6b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bc13c5-a448-42df-b33b-cacea0bf6b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b344564-ed16-42a6-837f-4791c821fc6d', 'volume_name': 'volume-5b344564-ed16-42a6-837f-4791c821fc6d', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c4a6f-0bec-4b37-b4f3-1f3663c53ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58c4a6f-0bec-4b37-b4f3-1f3663c53ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ec8e0d-cc15-4221-afee-4c894ae40783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:03 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Volume 5b344564-ed16-42a6-837f-4791c821fc6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b344564-ed16-42a6-837f-4791c821fc6d', 'volume_size': 1}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1159628083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b344564-ed16-42a6-837f-4791c821fc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b809da00a4445e6b2e586b116730dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:03Z,use_quota=True,user_id='d82877b8c3c84bd3a4127bac56db79d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Creating volume 5b344564-ed16-42a6-837f-4791c821fc6d {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:03 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:03 devstack sudo[86686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d 1073741824
Apr 20 17:33:03 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:03 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b" returned: 0 in 0.519s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:03 devstack sudo[86691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277
Apr 20 17:33:03 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-6508439c-211a-4800-b555-55309d88f049-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Lock "cinder-6508439c-211a-4800-b555-55309d88f049-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-quobyte-6508439c-211a-4800-b555-55309d88f049" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-6508439c-211a-4800-b555-55309d88f049" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0177197-3ad6-4117-9339-0b9019756a22]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:03 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d 1073741824" returned: 0 in 0.660s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:03 devstack sudo[86701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d
Apr 20 17:33:03 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:03 devstack sudo[86697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049
Apr 20 17:33:03 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:03 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277" returned: 0 in 0.545s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:03 devstack sudo[86704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277
Apr 20 17:33:03 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:04 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b.e7bec592-ce09-4e79-bbb7-31b032799277" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:04 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d" returned: 0 in 0.564s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:04 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049" returned: 0 in 0.667s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-quobyte-e7bec592-ce09-4e79-bbb7-31b032799277" released by "_delete_snapshot" :: held 2.292s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ec8e0d-cc15-4221-afee-4c894ae40783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b344564-ed16-42a6-837f-4791c821fc6d', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68da500-1baf-49bd-adf9-c5587c0762cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:04 devstack sudo[86715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049
Apr 20 17:33:04 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-quobyte-f795e0f8-cceb-47ec-94b8-04d58259ad3b" released by "delete_snapshot" :: held 2.350s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:04 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Volume volume-5b344564-ed16-42a6-837f-4791c821fc6d (5b344564-ed16-42a6-837f-4791c821fc6d): created successfully
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68da500-1baf-49bd-adf9-c5587c0762cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Flow 'volume_create_manager' (5e8560e4-301a-477c-8d51-efe1fdb90b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:04 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ec54af16-8087-48f0-af9e-5158a587804c tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Created volume successfully.
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Created reservations ['8dde87b7-3cae-452c-9abd-fe5ee3cb98f2', '6278031d-c8a5-480e-80ca-60f8a5862455', 'cee49f48-d848-44dc-a06b-09f2d4bd21f3', '4d978b76-8fbb-4808-9098-c118c70b38ef'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:04 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Delete snapshot completed successfully.
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3c917b5b-926f-4eed-8f35-1e28603b99a2 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-e7bec592-ce09-4e79-bbb7-31b032799277-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:04 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6508439c-211a-4800-b555-55309d88f049" returned: 0 in 0.503s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-6508439c-211a-4800-b555-55309d88f049" released by "delete_volume" :: held 1.193s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Created reservations ['ebdb2bdc-37d0-42e4-a523-afae83a1021a', 'fc67ab0c-b441-408c-b115-e051d073904a', '444ebb82-47b5-4083-9d81-564f403d7955', '69550af9-8eae-481d-b50b-86c642b6e558'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:04 devstack sudo[86733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:04 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Acquiring lock "cinder-f795e0f8-cceb-47ec-94b8-04d58259ad3b-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-f795e0f8-cceb-47ec-94b8-04d58259ad3b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Acquiring lock "cinder-quobyte-f795e0f8-cceb-47ec-94b8-04d58259ad3b" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Creating offline snapshot cd18ff3d-b26c-452f-b7b9-75a47dfa765d of volume 5b344564-ed16-42a6-837f-4791c821fc6d {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-quobyte-f795e0f8-cceb-47ec-94b8-04d58259ad3b" acquired by "delete_volume" :: waited 0.040s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c2b438-b06b-4eaf-8fa0-c17142d3f052]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1460ea47-daeb-4136-a3bd-fb93d0a4f694]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:05 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.849s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:05 devstack sudo[86772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b
Apr 20 17:33:05 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:05 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Deleted volume successfully.
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55bca8a0-b4df-45f5-b707-e4f9a20b553a tempest-VolumesGetTest-992452388 None] Lock "cinder-6508439c-211a-4800-b555-55309d88f049-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-43c6943b-e50c-48d5-9bb3-5d4596bf08f4-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:06 devstack sudo[86771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d
Apr 20 17:33:06 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Lock "cinder-43c6943b-e50c-48d5-9bb3-5d4596bf08f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-quobyte-43c6943b-e50c-48d5-9bb3-5d4596bf08f4" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-43c6943b-e50c-48d5-9bb3-5d4596bf08f4" acquired by "delete_volume" :: waited 0.017s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce09e4b-baa3-496b-badb-2425944a8ba3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:06 devstack sudo[86777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4
Apr 20 17:33:06 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:06 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b" returned: 0 in 0.994s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:06 devstack sudo[86784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b
Apr 20 17:33:06 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:06 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4" returned: 0 in 0.739s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:06 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d" returned: 0 in 1.246s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:06 devstack sudo[86790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4
Apr 20 17:33:06 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:06 devstack sudo[86792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d 1G
Apr 20 17:33:06 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:07 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f795e0f8-cceb-47ec-94b8-04d58259ad3b" returned: 0 in 0.582s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-quobyte-f795e0f8-cceb-47ec-94b8-04d58259ad3b" released by "delete_volume" :: held 1.677s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Created reservations ['93473c41-dd7e-4c93-b038-6d809a8d9ee4', '52cebdae-345d-4d99-b87d-7e1f37df47c8', 'd92d62cb-570a-4421-9eca-449c212c8d79', '2057c56b-56dc-4c12-8991-27b86c889d3a'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:07 devstack sudo[86795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:07 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:07 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-43c6943b-e50c-48d5-9bb3-5d4596bf08f4" returned: 0 in 0.917s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-43c6943b-e50c-48d5-9bb3-5d4596bf08f4" released by "delete_volume" :: held 1.746s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:07 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Created reservations ['cdc198e6-7186-48eb-baca-796e1b182967', 'f356dbcf-4e85-4d60-a3e5-bb571c7a4979', 'da981906-bd03-46f9-b2a0-48d14e176fb7', 'd2726544-8c8d-4871-8428-67c39ac5aeca'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:08 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.742s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:08 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Deleted volume successfully.
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-844bf872-2e92-44c4-99da-45f0abc1cfc1 tempest-VolumesSnapshotNegativeTestJSON-1145649087 None] Lock "cinder-f795e0f8-cceb-47ec-94b8-04d58259ad3b-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:08 devstack sudo[86804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:08 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:08 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d 1G" returned: 0 in 1.534s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b344564-ed16-42a6-837f-4791c821fc6d -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:08 devstack sudo[86806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b344564-ed16-42a6-837f-4791c821fc6d -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d
Apr 20 17:33:08 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:08 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.706s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:08 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Deleted volume successfully.
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bba932a9-3d84-4dc0-b98f-f7a41e703aa3 tempest-VolumesGetTest-992452388 None] Lock "cinder-43c6943b-e50c-48d5-9bb3-5d4596bf08f4-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (20410369-eeaa-4b1a-8759-1663bbd9646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5207376c-95e7-4c6e-bbe7-8e955f2c8a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5207376c-95e7-4c6e-bbe7-8e955f2c8a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1259730900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59818c3-ad5b-45fb-bc8e-1de7d945b4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:09Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf76e02-3e74-4717-b8ed-3f75d3a01f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf76e02-3e74-4717-b8ed-3f75d3a01f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6f02c4-b391-43c2-bd69-2829b82851a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6f02c4-b391-43c2-bd69-2829b82851a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59818c3-ad5b-45fb-bc8e-1de7d945b4c0', 'volume_name': 'volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acdcaed-a0ca-4a14-af2d-11dd9eb87ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acdcaed-a0ca-4a14-af2d-11dd9eb87ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622f3616-9952-4ed9-b0b5-2051cdc1ed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:08 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Volume e59818c3-ad5b-45fb-bc8e-1de7d945b4c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0', 'volume_size': 1}
Apr 20 17:33:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:09 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b344564-ed16-42a6-837f-4791c821fc6d -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d" returned: 0 in 0.721s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:09 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d is being set with open permissions: ugo+rw
Apr 20 17:33:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:09 devstack sudo[86812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d
Apr 20 17:33:09 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:09 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d" returned: 0 in 0.535s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:09 devstack sudo[86815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.info
Apr 20 17:33:09 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:10 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.info" returned: 0 in 0.540s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:10 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.info is being set with open permissions: ugo+rw
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:10 devstack sudo[86818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.info
Apr 20 17:33:10 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Flow 'volume_create_manager' (6cef3bdc-bb62-46f2-a3d0-7b4624cc7a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a118d4cc-9fd9-4b95-81c2-bede4f433501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a118d4cc-9fd9-4b95-81c2-bede4f433501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1208336937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815333cf07b45af89acff9c03372b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:10Z,use_quota=True,user_id='f7848222ba474dc5a4aa2201b6d153c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46336d7f-0305-4236-8213-55e4d47a3ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46336d7f-0305-4236-8213-55e4d47a3ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5a849d-6895-42d2-9c58-4cc3ace466a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5a849d-6895-42d2-9c58-4cc3ace466a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1', 'volume_name': 'volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066635c4-af11-47e7-be09-9c5514dd6363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066635c4-af11-47e7-be09-9c5514dd6363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4000c88f-01cd-41f3-bdb3-b3ff1003a7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:10 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Volume 4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1', 'volume_size': 1}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:10 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.info" returned: 0 in 0.661s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.397s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.014s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1259730900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59818c3-ad5b-45fb-bc8e-1de7d945b4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:09Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Creating volume e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:10 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:10 devstack sudo[86841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 1073741824
Apr 20 17:33:10 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c1d6f189-2f17-4791-8c2a-29656d5ae141 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Create snapshot completed successfully
Apr 20 17:33:11 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 1073741824" returned: 0 in 0.730s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:11 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0
Apr 20 17:33:11 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:12 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" returned: 0 in 0.574s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.761s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1208336937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815333cf07b45af89acff9c03372b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:10Z,use_quota=True,user_id='f7848222ba474dc5a4aa2201b6d153c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Creating volume 4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:12 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:12 devstack sudo[86876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 1073741824
Apr 20 17:33:12 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Acquiring lock "cinder-cd18ff3d-b26c-452f-b7b9-75a47dfa765d-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622f3616-9952-4ed9-b0b5-2051cdc1ed3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d43648-e91c-4a5e-bd69-6da04a15a898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-cd18ff3d-b26c-452f-b7b9-75a47dfa765d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Acquiring lock "cinder-quobyte-5b344564-ed16-42a6-837f-4791c821fc6d" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:12 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Volume volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 (e59818c3-ad5b-45fb-bc8e-1de7d945b4c0): created successfully
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d43648-e91c-4a5e-bd69-6da04a15a898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (20410369-eeaa-4b1a-8759-1663bbd9646a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-quobyte-5b344564-ed16-42a6-837f-4791c821fc6d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Acquiring lock "cinder-quobyte-cd18ff3d-b26c-452f-b7b9-75a47dfa765d" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-42acad5b-b91c-49e6-8b2f-96cfa1c42a99 tempest-VolumesGetTest-992452388 None] Created volume successfully.
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-quobyte-cd18ff3d-b26c-452f-b7b9-75a47dfa765d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Deleting offline snapshot cd18ff3d-b26c-452f-b7b9-75a47dfa765d of volume 5b344564-ed16-42a6-837f-4791c821fc6d {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] snapshot_file for this snap is: volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c920b7-53e0-4566-9dfc-5eb38b8f9bb6]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:12 devstack sudo[86879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d
Apr 20 17:33:12 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Acquiring lock "cinder-c8d20f55-6f6a-4376-ac6d-cda74e9e379a-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "cinder-c8d20f55-6f6a-4376-ac6d-cda74e9e379a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Acquiring lock "cinder-quobyte-c8d20f55-6f6a-4376-ac6d-cda74e9e379a" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "cinder-quobyte-c8d20f55-6f6a-4376-ac6d-cda74e9e379a" acquired by "delete_volume" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:13 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5217a5e-bb1f-45ac-909d-6a0d7a9aa978]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:13 devstack sudo[86883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a
Apr 20 17:33:13 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:13 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d" returned: 0 in 1.176s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b344564-ed16-42a6-837f-4791c821fc6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:33:13 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcabf08-a214-4da1-b24f-52a40de267c6]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:13 devstack sudo[86894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d
Apr 20 17:33:13 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:13 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (46c8c167-11e0-4835-a8db-3fab5d7e7143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db325295-7594-4af4-99fd-711cb9bb718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db325295-7594-4af4-99fd-711cb9bb718b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1660975299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c46ae4-ccae-41c8-aa59-88f05ef1beaa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e59818c3-ad5b-45fb-bc8e-1de7d945b4c0,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:14Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0bc5b4-77ac-4314-b2f1-637bbc127ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0bc5b4-77ac-4314-b2f1-637bbc127ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916a5cca-57a2-45f0-bcf0-a57821972380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916a5cca-57a2-45f0-bcf0-a57821972380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '99c46ae4-ccae-41c8-aa59-88f05ef1beaa', 'volume_name': 'volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa', 'volume_size': 1, 'source_volid': 'e59818c3-ad5b-45fb-bc8e-1de7d945b4c0', 'source_volstatus': 'available'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6417ca66-abd4-49f4-855f-172a63ce5a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6417ca66-abd4-49f4-855f-172a63ce5a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44db77e0-1556-48dd-9711-62fef9b2381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:14 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Volume 99c46ae4-ccae-41c8-aa59-88f05ef1beaa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa', 'volume_size': 1, 'source_volid': 'e59818c3-ad5b-45fb-bc8e-1de7d945b4c0', 'source_volstatus': 'available'}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:14 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a" returned: 0 in 1.337s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:14 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a
Apr 20 17:33:14 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:14 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 1073741824" returned: 0 in 2.023s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:14 devstack sudo[86902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1
Apr 20 17:33:14 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:14 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d" returned: 0 in 1.159s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:14 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:14 devstack sudo[86910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d
Apr 20 17:33:14 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c8d20f55-6f6a-4376-ac6d-cda74e9e379a" returned: 0 in 0.588s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "cinder-quobyte-c8d20f55-6f6a-4376-ac6d-cda74e9e379a" released by "delete_volume" :: held 2.043s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Created reservations ['a331a68b-aa60-436c-8a30-23755ac3e577', '78ce98de-e983-4d3c-8baa-48ae8ad4178c', 'bd76f989-6320-4a1f-b14b-3478de095197', '116e8ae5-0ceb-4584-9482-09737e658a1d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:15 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:15 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:15 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" returned: 0 in 0.740s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] <== create_volume: return (2811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.819s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.942s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:15 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Cloning volume e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 to volume 99c46ae4-ccae-41c8-aa59-88f05ef1beaa
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Creating offline snapshot 3a5d1046-74d4-4003-89d5-008ccd047aac of volume e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4000c88f-01cd-41f3-bdb3-b3ff1003a7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bafb1dc-0a36-4463-9f62-1c682db7879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c1db1-3d46-4b6c-8913-e3633a4f928b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:15 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Volume volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 (4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1): created successfully
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bafb1dc-0a36-4463-9f62-1c682db7879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Flow 'volume_create_manager' (6cef3bdc-bb62-46f2-a3d0-7b4624cc7a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:15 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e9aeb166-fd8c-48eb-8f12-7bd76cab5444 tempest-VolumeDependencyTests-2106981982 None] Created volume successfully.
Apr 20 17:33:15 devstack sudo[86915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0
Apr 20 17:33:15 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:15 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d" returned: 0 in 0.776s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:15 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d
Apr 20 17:33:15 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:15 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.649s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:15 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Deleted volume successfully.
Apr 20 17:33:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-51edfe19-1152-43bc-9c09-2a71d845d886 tempest-ServerRescueNegativeTestJSON-105297650 None] Lock "cinder-c8d20f55-6f6a-4376-ac6d-cda74e9e379a-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:16 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" returned: 0 in 0.896s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:16 devstack sudo[86930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac 1G
Apr 20 17:33:16 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:16 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d.cd18ff3d-b26c-452f-b7b9-75a47dfa765d" returned: 0 in 0.738s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-quobyte-cd18ff3d-b26c-452f-b7b9-75a47dfa765d" released by "_delete_snapshot" :: held 3.994s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-quobyte-5b344564-ed16-42a6-837f-4791c821fc6d" released by "delete_snapshot" :: held 4.012s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Created reservations ['d78900e0-753c-4fe1-a03b-7aceb450e446', 'df5e889f-e56f-4296-8beb-3baae4699042', 'd0bac96e-4b3e-4e53-b6a6-e249a2d945cf', '019edc88-1de1-44a5-8a79-d0942f5715e4'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:16 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Delete snapshot completed successfully.
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-882aabca-0391-4fd2-8fff-f88d6388c8f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-cd18ff3d-b26c-452f-b7b9-75a47dfa765d-delete_snapshot" released by "delete_snapshot" :: held 4.131s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Acquiring lock "cinder-5b344564-ed16-42a6-837f-4791c821fc6d-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-5b344564-ed16-42a6-837f-4791c821fc6d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Acquiring lock "cinder-quobyte-5b344564-ed16-42a6-837f-4791c821fc6d" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-quobyte-5b344564-ed16-42a6-837f-4791c821fc6d" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:16 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac 1G" returned: 0 in 0.679s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e49f65-972e-410d-a54a-4c7a6d2d15d3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:16 devstack sudo[86964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac
Apr 20 17:33:16 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:16 devstack sudo[86965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d
Apr 20 17:33:16 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:17 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac" returned: 0 in 0.590s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:17 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac is being set with open permissions: ugo+rw
Apr 20 17:33:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:17 devstack sudo[86975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac
Apr 20 17:33:17 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:17 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d" returned: 0 in 0.613s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:17 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d
Apr 20 17:33:17 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:17 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac" returned: 0 in 0.445s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:17 devstack sudo[86982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.info
Apr 20 17:33:17 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:17 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b344564-ed16-42a6-837f-4791c821fc6d" returned: 0 in 0.474s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-quobyte-5b344564-ed16-42a6-837f-4791c821fc6d" released by "delete_volume" :: held 1.164s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Created reservations ['defcac46-52e8-4cce-884d-6ddd545c54aa', '82226e77-641d-40e3-818d-661646dcb775', '3af93ef8-9568-4924-b20c-137a55cc1c4a', 'b5bfd8af-932f-47da-a858-551fa213a4b9'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:18 devstack sudo[86984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:18 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:18 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.info" returned: 0 in 0.536s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:18 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.info is being set with open permissions: ugo+rw
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:18 devstack sudo[86988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.info
Apr 20 17:33:18 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:18 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:18 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Deleted volume successfully.
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5f07631b-1cb6-4f29-9394-905fcce49974 tempest-VolumeSnapshotQuotasNegativeTestJSON-756835470 None] Lock "cinder-5b344564-ed16-42a6-837f-4791c821fc6d-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:18 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.info" returned: 0 in 0.424s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-quobyte-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] snapshot: 3a5d1046-74d4-4003-89d5-008ccd047aac, volume: 99c46ae4-ccae-41c8-aa59-88f05ef1beaa,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[652cf27b-925d-41f4-9d7e-128898b3d770]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:18 devstack sudo[86992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac
Apr 20 17:33:18 devstack sudo[86992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:19 devstack sudo[86992]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac" returned: 0 in 0.554s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:33:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:33:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:33:19 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e35ba-06b2-46e1-93ca-a3c47778ead7]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:19 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0
Apr 20 17:33:19 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:19 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" returned: 0 in 0.523s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:19 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:33:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:20 devstack sudo[87002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa
Apr 20 17:33:20 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:22 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" returned: 0 in 2.887s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:22 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e4b770-9485-4442-9b3a-d72b9c02ff6e]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:22 devstack sudo[87016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0
Apr 20 17:33:22 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:23 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" returned: 0 in 0.704s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:23 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0, size 1024.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:33:23 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Converted 1024.00 MB image at 354.43 MB/s
Apr 20 17:33:23 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa is being set with open permissions: ugo+rw
Apr 20 17:33:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:23 devstack sudo[87022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa
Apr 20 17:33:23 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:24 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" returned: 0 in 0.533s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" released by "_copy_volume_from_snapshot" :: held 5.254s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-quobyte-3a5d1046-74d4-4003-89d5-008ccd047aac" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-3a5d1046-74d4-4003-89d5-008ccd047aac" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Deleting offline snapshot 3a5d1046-74d4-4003-89d5-008ccd047aac of volume e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] snapshot_file for this snap is: volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bae31e-dfcf-4bcf-a77e-aad8a135368f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:24 devstack sudo[87033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac
Apr 20 17:33:24 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:24 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac" returned: 0 in 0.621s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5340ec90-7cf0-4393-826b-ce6d6a3501fd]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:24 devstack sudo[87058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0
Apr 20 17:33:24 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:25 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" returned: 0 in 0.520s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:25 devstack sudo[87063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac
Apr 20 17:33:25 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:25 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:25 devstack sudo[87070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac
Apr 20 17:33:25 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:26 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0.3a5d1046-74d4-4003-89d5-008ccd047aac" returned: 0 in 0.414s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-3a5d1046-74d4-4003-89d5-008ccd047aac" released by "_delete_snapshot" :: held 2.096s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.140s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.997s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44db77e0-1556-48dd-9711-62fef9b2381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa', 'volume_size': 1, 'source_volid': 'e59818c3-ad5b-45fb-bc8e-1de7d945b4c0', 'source_volstatus': 'available'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f3495a-e5c2-49b8-a27a-74776dc59afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Creating offline snapshot a958d822-27e4-4230-a9c2-12d4dd8fe91e of volume 4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:33:26 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Volume volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa (99c46ae4-ccae-41c8-aa59-88f05ef1beaa): created successfully
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f3495a-e5c2-49b8-a27a-74776dc59afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (46c8c167-11e0-4835-a8db-3fab5d7e7143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f59ef3-6259-450f-81fb-1cb42147209d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:26 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-82fa9653-cd67-4338-85f8-18888b27ff28 tempest-VolumesGetTest-992452388 None] Created volume successfully.
Apr 20 17:33:26 devstack sudo[87074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1
Apr 20 17:33:26 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:26 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" returned: 0 in 0.481s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:26 devstack sudo[87079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e 1G
Apr 20 17:33:26 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:27 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e 1G" returned: 0 in 0.618s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:27 devstack sudo[87084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e
Apr 20 17:33:27 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (6fc15b0e-ae06-4091-9188-d862bfb3b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa17f5a-6726-4d0a-8e28-2d9ffd34f49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa17f5a-6726-4d0a-8e28-2d9ffd34f49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-462444456',display_name='tempest-VolumesGetTest-Volume-2139393426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41219c47-2daa-4961-90f0-38bf6d41a93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:27Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6e7291-dd50-4585-99b1-d144a32951e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6e7291-dd50-4585-99b1-d144a32951e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402c622f-cbd8-4a71-9c2a-40ae130f97a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402c622f-cbd8-4a71-9c2a-40ae130f97a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41219c47-2daa-4961-90f0-38bf6d41a93b', 'volume_name': 'volume-41219c47-2daa-4961-90f0-38bf6d41a93b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79918202-3cfd-40fe-a287-c0821c85ebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79918202-3cfd-40fe-a287-c0821c85ebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f52fce-1248-4281-a10a-a6d00fca04a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:27 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Volume 41219c47-2daa-4961-90f0-38bf6d41a93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41219c47-2daa-4961-90f0-38bf6d41a93b', 'volume_size': 1}
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:27 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e" returned: 0 in 0.454s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:27 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e is being set with open permissions: ugo+rw
Apr 20 17:33:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:27 devstack sudo[87089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e
Apr 20 17:33:27 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:28 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e" returned: 0 in 0.426s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:28 devstack sudo[87092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.info
Apr 20 17:33:28 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Flow 'volume_create_manager' (d6f413e0-414d-4ec3-9250-bceba6a48c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff598edf-ec5d-4106-abd3-c666187a51bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff598edf-ec5d-4106-abd3-c666187a51bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1741939049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174c4e04-f762-4ff9-9594-10ad624120fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b291107036c446e296e6f300cc40171a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:29Z,use_quota=True,user_id='ab1e7c7c04ee4e5eb50d50e056dfafdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14806789-72d0-4407-bad2-c1ee3aa01a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:28 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14806789-72d0-4407-bad2-c1ee3aa01a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a85d43-2d86-4128-a65f-72aaa189ebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.image.glance [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Creating Keystone auth plugin from conf {{(pid=82690) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.info" returned: 0 in 0.481s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:28 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.info is being set with open permissions: ugo+rw
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:28 devstack sudo[87095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.info
Apr 20 17:33:28 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a85d43-2d86-4128-a65f-72aaa189ebba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '174c4e04-f762-4ff9-9594-10ad624120fe', 'volume_name': 'volume-174c4e04-f762-4ff9-9594-10ad624120fe', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91be81630>}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9425e399-87d5-45f4-970d-c1b6700e3837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9425e399-87d5-45f4-970d-c1b6700e3837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dc213a-51bc-4c31-8f00-fa32af43128c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:28 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Volume 174c4e04-f762-4ff9-9594-10ad624120fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-174c4e04-f762-4ff9-9594-10ad624120fe', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91be81630>}
Apr 20 17:33:28 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Trying to clone 174c4e04-f762-4ff9-9594-10ad624120fe from image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]). {{(pid=82690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 17:33:29 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaa8ae8-0ba5-4a9b-8f26-596256bbbdba]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:29 devstack sudo[87098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD
Apr 20 17:33:29 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:29 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.info" returned: 0 in 0.454s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-462444456',display_name='tempest-VolumesGetTest-Volume-2139393426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41219c47-2daa-4961-90f0-38bf6d41a93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:27Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Creating volume 41219c47-2daa-4961-90f0-38bf6d41a93b {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:29 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:29 devstack sudo[87101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b 1073741824
Apr 20 17:33:29 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:29 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-fa090f2e-0a52-47d7-99cb-edc9e0814ef2 tempest-VolumeDependencyTests-2106981982 None] Create snapshot completed successfully
Apr 20 17:33:29 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD" returned: 0 in 0.541s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Temporary image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e is fetched for user ab1e7c7c04ee4e5eb50d50e056dfafdb. {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[43351b3f-4f6f-4afd-aa1e-acaf26955696]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:29 devstack sudo[87109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD
Apr 20 17:33:29 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:29 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b 1073741824" returned: 0 in 0.591s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:29 devstack sudo[87111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b
Apr 20 17:33:29 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Flow 'volume_create_manager' (c64706d4-4cdd-46cf-9dd1-1907cf254189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c4085f-aa19-4502-98a9-13d92d3c6bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c4085f-aa19-4502-98a9-13d92d3c6bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2076984586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb9bf310-c2db-4f18-b0bf-05ffab412ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815333cf07b45af89acff9c03372b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a958d822-27e4-4230-a9c2-12d4dd8fe91e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:30Z,use_quota=True,user_id='f7848222ba474dc5a4aa2201b6d153c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da39d39f-f4fc-47b1-af65-daca91afe9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da39d39f-f4fc-47b1-af65-daca91afe9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dfbc80-3280-48e6-90ce-fb5fdda33c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6dfbc80-3280-48e6-90ce-fb5fdda33c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb9bf310-c2db-4f18-b0bf-05ffab412ff9', 'volume_name': 'volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9', 'volume_size': 1, 'snapshot_id': 'a958d822-27e4-4230-a9c2-12d4dd8fe91e'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51211413-fcda-4c34-bbdb-c15852939e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51211413-fcda-4c34-bbdb-c15852939e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbc665d-88df-47bf-a3cf-bd0a603ee8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:30 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Volume bb9bf310-c2db-4f18-b0bf-05ffab412ff9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9', 'volume_size': 1, 'snapshot_id': 'a958d822-27e4-4230-a9c2-12d4dd8fe91e'}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:30 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD" returned: 0 in 0.591s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:30 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b" returned: 0 in 0.500s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.131s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-a958d822-27e4-4230-a9c2-12d4dd8fe91e-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" by "_create_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f52fce-1248-4281-a10a-a6d00fca04a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41219c47-2daa-4961-90f0-38bf6d41a93b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce5a21e-dc72-4bdc-945d-2d05234e70eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-a958d822-27e4-4230-a9c2-12d4dd8fe91e-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Creating volume bb9bf310-c2db-4f18-b0bf-05ffab412ff9 from snapshot a958d822-27e4-4230-a9c2-12d4dd8fe91e {{(pid=82690) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:30 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Volume volume-41219c47-2daa-4961-90f0-38bf6d41a93b (41219c47-2daa-4961-90f0-38bf6d41a93b): created successfully
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce5a21e-dc72-4bdc-945d-2d05234e70eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (6fc15b0e-ae06-4091-9188-d862bfb3b667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:30 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b63659b4-b582-4de6-b37f-ecdf3cd27f4e tempest-VolumesGetTest-992452388 None] Created volume successfully.
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] snapshot: a958d822-27e4-4230-a9c2-12d4dd8fe91e, volume: bb9bf310-c2db-4f18-b0bf-05ffab412ff9,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf2c9f-6585-43bc-af94-9f353a891f81]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:30 devstack sudo[87118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e
Apr 20 17:33:30 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-41219c47-2daa-4961-90f0-38bf6d41a93b-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Lock "cinder-41219c47-2daa-4961-90f0-38bf6d41a93b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-quobyte-41219c47-2daa-4961-90f0-38bf6d41a93b" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-41219c47-2daa-4961-90f0-38bf6d41a93b" acquired by "delete_volume" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ad280-d751-4c66-985f-c16c4aa36656]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:30 devstack sudo[87120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b
Apr 20 17:33:30 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:31 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e" returned: 0 in 0.545s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4518bbe-257f-4697-937c-7906db50da2f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:31 devstack sudo[87125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1
Apr 20 17:33:31 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:31 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b" returned: 0 in 0.582s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:31 devstack sudo[87130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b
Apr 20 17:33:31 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:31 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" returned: 0 in 0.564s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9 not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:31 devstack sudo[87135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9
Apr 20 17:33:31 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:31 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-41219c47-2daa-4961-90f0-38bf6d41a93b" returned: 0 in 0.494s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-41219c47-2daa-4961-90f0-38bf6d41a93b" released by "delete_volume" :: held 1.103s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Created reservations ['c2b51123-a6f9-4953-b8c7-2495f2f2d838', 'f24743a2-2c91-49df-ad26-19d3ce7a387d', 'b6fdfeba-0e07-4aeb-9c6f-576fe09bc95b', '92027a7d-4fcf-4d35-a8d4-a33d559940e9'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:32 devstack sudo[87139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:32 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:33 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 1.211s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:33 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Deleted volume successfully.
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-99c46ae4-ccae-41c8-aa59-88f05ef1beaa-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-874c623e-ee8d-4c42-8f94-8216684b81b7 tempest-VolumesGetTest-992452388 None] Lock "cinder-41219c47-2daa-4961-90f0-38bf6d41a93b-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Lock "cinder-99c46ae4-ccae-41c8-aa59-88f05ef1beaa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-quobyte-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" acquired by "delete_volume" :: waited 0.024s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef79efc-7297-4175-8292-1cf945ec032b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:33 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa
Apr 20 17:33:33 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:33 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" returned: 0 in 2.371s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[086dd975-3731-491c-9999-2a418be1065c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:34 devstack sudo[87154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1
Apr 20 17:33:34 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:34 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" returned: 0 in 0.758s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:34 devstack sudo[87159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa
Apr 20 17:33:34 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:34 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" returned: 0 in 0.675s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:33:34 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Converted 1024.00 MB image at 431.62 MB/s
Apr 20 17:33:34 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9 is being set with open permissions: ugo+rw
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:34 devstack sudo[87165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9
Apr 20 17:33:34 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:34 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" returned: 0 in 0.514s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-99c46ae4-ccae-41c8-aa59-88f05ef1beaa" released by "delete_volume" :: held 1.326s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Created reservations ['0c7695cc-0260-446e-acca-211d4aae6770', '128cc27e-4d0b-4840-95b0-b2a05847254e', 'f13802f0-54b4-4456-8285-ecd8a205a9f4', 'b4f01894-d331-40ff-a084-5ab42785281d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:34 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:34 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:35 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" released by "_copy_volume_from_snapshot" :: held 4.681s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-a958d822-27e4-4230-a9c2-12d4dd8fe91e-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" released by "_create_volume_from_snapshot" :: held 4.717s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.737s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.811s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1741939049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174c4e04-f762-4ff9-9594-10ad624120fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b291107036c446e296e6f300cc40171a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:29Z,use_quota=True,user_id='ab1e7c7c04ee4e5eb50d50e056dfafdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Creating volume 174c4e04-f762-4ff9-9594-10ad624120fe {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:35 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:35 devstack sudo[87171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe 1073741824
Apr 20 17:33:35 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbc665d-88df-47bf-a3cf-bd0a603ee8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9', 'volume_size': 1, 'snapshot_id': 'a958d822-27e4-4230-a9c2-12d4dd8fe91e'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb06f44-b6f8-4adf-ad31-ba9dc2293d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:35 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Volume volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9 (bb9bf310-c2db-4f18-b0bf-05ffab412ff9): created successfully
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb06f44-b6f8-4adf-ad31-ba9dc2293d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Flow 'volume_create_manager' (c64706d4-4cdd-46cf-9dd1-1907cf254189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-2f15fe7c-721e-46de-a446-fee63ecc005a tempest-VolumeDependencyTests-2106981982 None] Created volume successfully.
Apr 20 17:33:35 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.470s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Deleted volume successfully.
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-faf19475-36c4-4b44-b491-fb38f2e5fbd6 tempest-VolumesGetTest-992452388 None] Lock "cinder-99c46ae4-ccae-41c8-aa59-88f05ef1beaa-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-a958d822-27e4-4230-a9c2-12d4dd8fe91e-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-a958d822-27e4-4230-a9c2-12d4dd8fe91e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-a958d822-27e4-4230-a9c2-12d4dd8fe91e" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-a958d822-27e4-4230-a9c2-12d4dd8fe91e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Deleting offline snapshot a958d822-27e4-4230-a9c2-12d4dd8fe91e of volume 4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] snapshot_file for this snap is: volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[60979f51-3f20-44bb-9455-490c017841d2]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Lock "cinder-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:35 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e
Apr 20 17:33:35 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-quobyte-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a11468-62d1-434c-bc2b-abaeb7ebb4d7]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:35 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe 1073741824" returned: 0 in 0.629s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:35 devstack sudo[87179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe
Apr 20 17:33:35 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:35 devstack sudo[87178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0
Apr 20 17:33:35 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:36 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e" returned: 0 in 0.601s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[02121a95-58fe-46b8-8df0-fba356028346]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:36 devstack sudo[87190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1
Apr 20 17:33:36 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:36 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe" returned: 0 in 0.501s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Attempting download of 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}])) to volume 174c4e04-f762-4ff9-9594-10ad624120fe. {{(pid=82690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 17:33:36 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" returned: 0 in 0.573s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c90a3c-2942-42d0-89b0-78763852466a]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:36 devstack sudo[87192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0
Apr 20 17:33:36 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_rgvv51b6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:36 devstack sudo[87194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_rgvv51b6
Apr 20 17:33:36 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:36 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" returned: 0 in 0.506s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:36 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e
Apr 20 17:33:36 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:36 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" returned: 0 in 0.444s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0" released by "delete_volume" :: held 1.055s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Created reservations ['4e24c4a4-c40a-4e8b-a839-85b1387ae312', '08cac5cf-8fb7-49e6-beb0-487efb7224a0', '90b6645b-5f9f-42b1-bd58-ae77a9cbfae7', '22f319af-f1d4-4d38-9e20-5702e578d98c'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:36 devstack sudo[87204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:36 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:36 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_rgvv51b6" returned: 0 in 0.579s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_rgvv51b6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:37 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_rgvv51b6
Apr 20 17:33:37 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:37 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:37 devstack sudo[87211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e
Apr 20 17:33:37 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:37 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.483s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Deleted volume successfully.
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e28f04b-9d5c-4065-9162-ba5e52baa6da tempest-VolumesGetTest-992452388 None] Lock "cinder-e59818c3-ad5b-45fb-bc8e-1de7d945b4c0-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:37 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_rgvv51b6" returned: 1 in 0.541s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_rgvv51b6' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c1343-72d1-4543-b79b-46b37407b731]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:37 devstack sudo[87216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD
Apr 20 17:33:37 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:37 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1.a958d822-27e4-4230-a9c2-12d4dd8fe91e" returned: 0 in 0.564s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-a958d822-27e4-4230-a9c2-12d4dd8fe91e" released by "_delete_snapshot" :: held 2.234s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" released by "delete_snapshot" :: held 2.258s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Created reservations ['f2de1ba3-3a2e-49bb-925a-ef07a3d511b5', 'efd7fa47-e94c-4b39-92cc-2787dd0ccac7', '12b72fb1-a0f0-44e0-93d6-81d586fec3b4', '9dc9ed3f-3384-44c9-98ca-d268524fd7ac'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Delete snapshot completed successfully.
Apr 20 17:33:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b07d966a-5773-46bf-862d-fdfe39afb4ff tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-a958d822-27e4-4230-a9c2-12d4dd8fe91e-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:38 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD" returned: 0 in 0.673s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e was qcow2, converting to raw {{(pid=82690) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:38 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe
Apr 20 17:33:38 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (e6bf369a-64b3-42f8-810b-86cea14d1e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62045861-9885-464c-a1c3-baedd95e87bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62045861-9885-464c-a1c3-baedd95e87bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1727616558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4243ff-2d3a-4488-a10b-24a89ba28144,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:38Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a00cd9-00ac-4dff-aff5-457c6ea337e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9a00cd9-00ac-4dff-aff5-457c6ea337e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e5300c-7fff-4cfa-a877-8c4ad9a2bb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.image.glance [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Creating Keystone auth plugin from conf {{(pid=82690) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e5300c-7fff-4cfa-a877-8c4ad9a2bb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c4243ff-2d3a-4488-a10b-24a89ba28144', 'volume_name': 'volume-1c4243ff-2d3a-4488-a10b-24a89ba28144', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91bf3e470>}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75de12f4-4265-4294-a77f-873f0f8cae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75de12f4-4265-4294-a77f-873f0f8cae43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11000bc5-c994-4524-bf3b-44bf754a66dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:38 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Volume 1c4243ff-2d3a-4488-a10b-24a89ba28144: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c4243ff-2d3a-4488-a10b-24a89ba28144', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91bf3e470>}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Trying to clone 1c4243ff-2d3a-4488-a10b-24a89ba28144 from image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]). {{(pid=82690) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" acquired by "delete_volume" :: waited 0.018s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c504d65b-6656-4c95-b142-8742c5bb8abe]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 20 17:33:38 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Image download 20.69 MB at 20.69 MB/s
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf5dde8-88db-4bf7-8a69-163a0f160a2b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:39 devstack sudo[87238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1
Apr 20 17:33:39 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:39 devstack sudo[87239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD
Apr 20 17:33:39 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:39 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe" returned: 0 in 0.983s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_fjy5fro9devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:33:39 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Converted 112.00 MB image at 112.00 MB/s
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:39 devstack sudo[87242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe 1G
Apr 20 17:33:39 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:39 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" returned: 0 in 0.684s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:39 devstack sudo[87250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1
Apr 20 17:33:39 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:39 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Temporary image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e is fetched for user 36a19e0016564f68987bd40cc95d8603. {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca27b903-4c51-4694-8c58-4107107cc466]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:39 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD
Apr 20 17:33:39 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:39 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe 1G" returned: 0 in 0.681s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aae2c9-c3a8-4e4e-91ff-106629106d9d]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:40 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe
Apr 20 17:33:40 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:40 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" returned: 0 in 0.547s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1" released by "delete_volume" :: held 1.263s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Created reservations ['34f36abd-94df-4443-93f3-7f31a2530d7e', '00839dfc-8073-4c93-945a-197e54bf431d', '8029c17f-4329-4cdc-b3b7-b03334c49542', '9e5d9fa9-8d63-46c8-b91b-885cf849d31f'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:40 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1727616558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4243ff-2d3a-4488-a10b-24a89ba28144,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:38Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Creating volume 1c4243ff-2d3a-4488-a10b-24a89ba28144 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:40 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:40 devstack sudo[87263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:40 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:40 devstack sudo[87264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 1073741824
Apr 20 17:33:40 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:40 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe" returned: 0 in 0.636s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:40 devstack sudo[87269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe
Apr 20 17:33:40 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:40 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.524s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:40 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Deleted volume successfully.
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b3290ad0-3fbd-499c-85d1-de955a629d7b tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-4955f6f3-9ad2-4ac6-b21b-362fb7c0c2f1-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:40 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 1073741824" returned: 0 in 0.606s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:40 devstack sudo[87275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144
Apr 20 17:33:40 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:41 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe" returned: 1 in 0.613s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Downloaded image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}])) to volume 174c4e04-f762-4ff9-9594-10ad624120fe successfully. {{(pid=82690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Temporary image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e for user ab1e7c7c04ee4e5eb50d50e056dfafdb is deleted. {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Marking volume 174c4e04-f762-4ff9-9594-10ad624120fe as bootable. {{(pid=82690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Copying metadata from image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e to 174c4e04-f762-4ff9-9594-10ad624120fe. {{(pid=82690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Creating volume glance metadata for volume 174c4e04-f762-4ff9-9594-10ad624120fe backed by image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Flow 'volume_create_manager' (60af37e9-fbe3-4ac1-9b3d-778bb6ba527e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ee81ce-d430-4a9e-a385-66c8b6b73f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dc213a-51bc-4c31-8f00-fa32af43128c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-174c4e04-f762-4ff9-9594-10ad624120fe', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91be81630>}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c25cb4-7d1d-4146-9bb2-aa1742fdbd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ee81ce-d430-4a9e-a385-66c8b6b73f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1381537601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8cff65-0a44-4eb7-88cf-62b9d18e05d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815333cf07b45af89acff9c03372b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:41Z,use_quota=True,user_id='f7848222ba474dc5a4aa2201b6d153c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c241077a-eceb-47b9-8577-f7795f7f0ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c241077a-eceb-47b9-8577-f7795f7f0ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be7c205-db77-44ae-9a67-ceb159938c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be7c205-db77-44ae-9a67-ceb159938c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8cff65-0a44-4eb7-88cf-62b9d18e05d3', 'volume_name': 'volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4459690-1168-4663-8824-591b22b9286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4459690-1168-4663-8824-591b22b9286c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5152ba-4dc7-41d3-a411-c2c913c636c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:41 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Volume 0f8cff65-0a44-4eb7-88cf-62b9d18e05d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3', 'volume_size': 1}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:41 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Volume volume-174c4e04-f762-4ff9-9594-10ad624120fe (174c4e04-f762-4ff9-9594-10ad624120fe): created successfully
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c25cb4-7d1d-4146-9bb2-aa1742fdbd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Flow 'volume_create_manager' (d6f413e0-414d-4ec3-9250-bceba6a48c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:41 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9390a9a2-3818-4ff3-9670-cbad1026da79 tempest-VolumesImageMetadata-362568348 None] Created volume successfully.
Apr 20 17:33:41 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144" returned: 0 in 0.538s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1381537601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8cff65-0a44-4eb7-88cf-62b9d18e05d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815333cf07b45af89acff9c03372b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:41Z,use_quota=True,user_id='f7848222ba474dc5a4aa2201b6d153c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Creating volume 0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:41 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Attempting download of 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}])) to volume 1c4243ff-2d3a-4488-a10b-24a89ba28144. {{(pid=82690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 20 17:33:41 devstack sudo[87281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 1073741824
Apr 20 17:33:41 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[119c0657-fabd-4842-8f42-ab92e74562c3]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_pm9vlvrg {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:41 devstack sudo[87283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_pm9vlvrg
Apr 20 17:33:41 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Acquiring lock "cinder-174c4e04-f762-4ff9-9594-10ad624120fe-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Lock "cinder-174c4e04-f762-4ff9-9594-10ad624120fe-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Acquiring lock "cinder-quobyte-174c4e04-f762-4ff9-9594-10ad624120fe" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Lock "cinder-quobyte-174c4e04-f762-4ff9-9594-10ad624120fe" acquired by "delete_volume" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f835d-f5ac-458e-9302-aec00830428a]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:42 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_pm9vlvrg" returned: 0 in 0.578s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_pm9vlvrg {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:42 devstack sudo[87290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe
Apr 20 17:33:42 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:42 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 1073741824" returned: 0 in 0.724s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:42 devstack sudo[87293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3
Apr 20 17:33:42 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:42 devstack sudo[87291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_pm9vlvrg
Apr 20 17:33:42 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:42 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe" returned: 0 in 0.625s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:42 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" returned: 0 in 0.506s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5152ba-4dc7-41d3-a411-c2c913c636c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd719d6-8f89-4289-8a06-7a76d4ec839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:42 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:42 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Volume volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 (0f8cff65-0a44-4eb7-88cf-62b9d18e05d3): created successfully
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd719d6-8f89-4289-8a06-7a76d4ec839c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Flow 'volume_create_manager' (60af37e9-fbe3-4ac1-9b3d-778bb6ba527e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:42 devstack sudo[87303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe
Apr 20 17:33:42 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_pm9vlvrg" returned: 1 in 0.651s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_pm9vlvrg' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d1a769-5f4d-48c3-830c-e90632a95462]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c953f172-c547-4d83-a641-755cddb1d6ad tempest-VolumeDependencyTests-2106981982 None] Created volume successfully.
Apr 20 17:33:42 devstack sudo[87305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD
Apr 20 17:33:42 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:43 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe" returned: 1 in 0.516s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:43 devstack sudo[87310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe
Apr 20 17:33:43 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:43 devstack sudo[87315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:43 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:43 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e was qcow2, converting to raw {{(pid=82690) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:43 devstack sudo[87317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144
Apr 20 17:33:43 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:43 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-174c4e04-f762-4ff9-9594-10ad624120fe" returned: 0 in 0.573s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Lock "cinder-quobyte-174c4e04-f762-4ff9-9594-10ad624120fe" released by "delete_volume" :: held 1.778s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Flow 'volume_create_manager' (60029b00-9f5c-4707-b5e1-fb05cfa4d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191b233e-ac77-4e72-964c-4c3d6193ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191b233e-ac77-4e72-964c-4c3d6193ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-914603458',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b143b94-c234-4914-8448-f3b3a12c9f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815333cf07b45af89acff9c03372b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=0f8cff65-0a44-4eb7-88cf-62b9d18e05d3,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:44Z,use_quota=True,user_id='f7848222ba474dc5a4aa2201b6d153c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87025ef-ed1e-454c-aa27-23464b36b266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87025ef-ed1e-454c-aa27-23464b36b266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72659cf1-a9ee-46d2-94b7-0c6d31037554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:43 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.664s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Created reservations ['7d0f12e7-dbe9-4374-b14e-8e28511b8a62', '8e7a95ea-643b-4a62-9ebc-c4fa75b8c458', '62bb9f68-d4ad-49ff-ab8d-7d05a3d8eed3', '2aa853fe-8975-47ca-8e86-1ec08b3e985b'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72659cf1-a9ee-46d2-94b7-0c6d31037554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5b143b94-c234-4914-8448-f3b3a12c9f4a', 'volume_name': 'volume-5b143b94-c234-4914-8448-f3b3a12c9f4a', 'volume_size': 1, 'source_volid': '0f8cff65-0a44-4eb7-88cf-62b9d18e05d3', 'source_volstatus': 'available'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7cae4b-9db2-4edb-9be7-ac7a353bd08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7cae4b-9db2-4edb-9be7-ac7a353bd08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537b0739-ab89-4963-bd26-c483276b03a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:43 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Volume 5b143b94-c234-4914-8448-f3b3a12c9f4a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5b143b94-c234-4914-8448-f3b3a12c9f4a', 'volume_size': 1, 'source_volid': '0f8cff65-0a44-4eb7-88cf-62b9d18e05d3', 'source_volstatus': 'available'}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:43 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Cloning volume 0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 to volume 5b143b94-c234-4914-8448-f3b3a12c9f4a
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Creating offline snapshot 8439b66a-5e70-45da-9426-1ba18cacb136 of volume 0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4838b-bafc-447e-88a9-460fdfce3718]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:44 devstack sudo[87341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:44 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:44 devstack sudo[87340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3
Apr 20 17:33:44 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:44 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144" returned: 0 in 1.022s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c6f1b19-af66-4a5e-b830-923e6c7dfa4e_dzppg2ssdevstack@QuobyteHD, size 112.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:33:44 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Converted 112.00 MB image at 109.40 MB/s
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:44 devstack sudo[87345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 1G
Apr 20 17:33:44 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:44 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.549s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:44 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Deleted volume successfully.
Apr 20 17:33:44 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" returned: 0 in 0.617s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-be016cb2-fe60-4056-a8bf-9fe0a831d402 tempest-VolumesImageMetadata-362568348 None] Lock "cinder-174c4e04-f762-4ff9-9594-10ad624120fe-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:44 devstack sudo[87351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 1G
Apr 20 17:33:44 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:44 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 1G" returned: 0 in 0.581s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b81a5-0e89-4053-b9d5-8813a8bd899c]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:45 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144
Apr 20 17:33:45 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:45 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 1G" returned: 0 in 0.607s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:45 devstack sudo[87361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136
Apr 20 17:33:45 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:45 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144" returned: 0 in 0.546s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:45 devstack sudo[87365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144
Apr 20 17:33:45 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:45 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136" returned: 0 in 0.512s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:45 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 is being set with open permissions: ugo+rw
Apr 20 17:33:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:45 devstack sudo[87370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136
Apr 20 17:33:45 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:46 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Flow 'volume_create_manager' (c6afdf3f-61dd-4f27-869a-00d9eabb1033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5003d20-8584-4811-8e2f-f93221d85211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144" returned: 1 in 0.566s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Downloaded image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e ((None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}])) to volume 1c4243ff-2d3a-4488-a10b-24a89ba28144 successfully. {{(pid=82690) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Temporary image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e for user 36a19e0016564f68987bd40cc95d8603 is deleted. {{(pid=82690) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.volume_utils [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Marking volume 1c4243ff-2d3a-4488-a10b-24a89ba28144 as bootable. {{(pid=82690) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5003d20-8584-4811-8e2f-f93221d85211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-111606855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530b3ca5-ed86-42e5-800a-b05856a62083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbad35f0877045ab85a1f776efe93412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:46Z,use_quota=True,user_id='a45a431be9ad466795e8026ee4a0a1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ad6977-c9e8-42b8-93de-4e18986a7dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ad6977-c9e8-42b8-93de-4e18986a7dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0bc658-643e-4dbe-b5c0-9cd9979cff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0bc658-643e-4dbe-b5c0-9cd9979cff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530b3ca5-ed86-42e5-800a-b05856a62083', 'volume_name': 'volume-530b3ca5-ed86-42e5-800a-b05856a62083', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23533e3c-9e49-4823-aa83-d16a42abd2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23533e3c-9e49-4823-aa83-d16a42abd2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e1c877-f376-4ba1-bf9f-30b3a47d1fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:46 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Volume 530b3ca5-ed86-42e5-800a-b05856a62083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530b3ca5-ed86-42e5-800a-b05856a62083', 'volume_size': 1}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Copying metadata from image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e to 1c4243ff-2d3a-4488-a10b-24a89ba28144. {{(pid=82690) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Creating volume glance metadata for volume 1c4243ff-2d3a-4488-a10b-24a89ba28144 backed by image 5c6f1b19-af66-4a5e-b830-923e6c7dfa4e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82690) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11000bc5-c994-4524-bf3b-44bf754a66dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c4243ff-2d3a-4488-a10b-24a89ba28144', 'volume_size': 1, 'image_id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8ecc5e92bba54eb284e92e156b8f2c9c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c6f1b19-af66-4a5e-b830-923e6c7dfa4e', 'created_at': datetime.datetime(2026, 4, 20, 15, 25, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 20, 15, 25, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c6f1b19-af66-4a5e-b830-923e6c7dfa4e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff91bf3e470>}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaac29b-e0f3-4813-a749-dbf83c3c1829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:46 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Volume volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 (1c4243ff-2d3a-4488-a10b-24a89ba28144): created successfully
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaac29b-e0f3-4813-a749-dbf83c3c1829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (e6bf369a-64b3-42f8-810b-86cea14d1e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:46 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136" returned: 0 in 0.444s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:46 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-530b5ecf-432a-411d-90fa-9f7f355dfd2a tempest-VolumesGetTest-992452388 None] Created volume successfully.
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:46 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.info
Apr 20 17:33:46 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:46 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.info" returned: 0 in 0.403s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:46 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.info is being set with open permissions: ugo+rw
Apr 20 17:33:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:46 devstack sudo[87380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.info
Apr 20 17:33:46 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:47 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.info" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-5b143b94-c234-4914-8448-f3b3a12c9f4a" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-5b143b94-c234-4914-8448-f3b3a12c9f4a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] snapshot: 8439b66a-5e70-45da-9426-1ba18cacb136, volume: 5b143b94-c234-4914-8448-f3b3a12c9f4a,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8a5ce5-1d41-4cfe-93cd-feb230bde7b2]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:47 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136
Apr 20 17:33:47 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (309a3059-1876-491f-89ad-2891191c6f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92040a4e-eab2-4604-b2f9-66b0804f3c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92040a4e-eab2-4604-b2f9-66b0804f3c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884934459',display_name='tempest-VolumesGetTest-Volume-357704739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3be249-57b1-4109-91a4-cd15b1fe3fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:47Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5029b28-f9f1-4e01-9078-1b31cff3ea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5029b28-f9f1-4e01-9078-1b31cff3ea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996cdefd-d82d-41d4-9328-660a4615b4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996cdefd-d82d-41d4-9328-660a4615b4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca3be249-57b1-4109-91a4-cd15b1fe3fdf', 'volume_name': 'volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8443d449-46d9-4e8a-a19c-879d31083fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8443d449-46d9-4e8a-a19c-879d31083fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff645ab-1813-4ccc-adee-74af8b9cd25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:47 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Volume ca3be249-57b1-4109-91a4-cd15b1fe3fdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf', 'volume_size': 1}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:47 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136" returned: 0 in 0.512s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dac070a-ca47-4b41-b388-d70b6d21725d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:47 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3
Apr 20 17:33:47 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:48 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" returned: 0 in 0.517s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:48 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:33:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:48 devstack sudo[87393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a
Apr 20 17:33:48 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:50 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a" returned: 0 in 2.368s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:50 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89281e9-54d2-419a-b50c-cc32ee12c692]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:50 devstack sudo[87416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3
Apr 20 17:33:50 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:51 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" returned: 0 in 0.579s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:33:51 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Converted 1024.00 MB image at 432.26 MB/s
Apr 20 17:33:51 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a is being set with open permissions: ugo+rw
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:51 devstack sudo[87426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a
Apr 20 17:33:51 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:51 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a" returned: 0 in 0.428s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-5b143b94-c234-4914-8448-f3b3a12c9f4a" released by "_copy_volume_from_snapshot" :: held 4.448s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=115,cinder:UPDATE=138,cinder:DELETE=12,cinder:INSERT=42 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-8439b66a-5e70-45da-9426-1ba18cacb136" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-8439b66a-5e70-45da-9426-1ba18cacb136" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Deleting offline snapshot 8439b66a-5e70-45da-9426-1ba18cacb136 of volume 0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] snapshot_file for this snap is: volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4005eb-a3cc-44c4-a690-f0760e530da7]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:51 devstack sudo[87429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136
Apr 20 17:33:51 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:52 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136" returned: 0 in 0.496s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:33:52 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[16621d35-b9aa-4d4f-98b5-2e6d9963cbc5]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:52 devstack sudo[87434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3
Apr 20 17:33:52 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:52 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:52 devstack sudo[87439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136
Apr 20 17:33:52 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:53 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136" returned: 0 in 0.474s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:53 devstack sudo[87447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136
Apr 20 17:33:53 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:53 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3.8439b66a-5e70-45da-9426-1ba18cacb136" returned: 0 in 0.434s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-8439b66a-5e70-45da-9426-1ba18cacb136" released by "_delete_snapshot" :: held 1.935s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=140,cinder:INSERT=55,cinder:UPDATE=155,cinder:DELETE=14 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.587s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.413s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-111606855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530b3ca5-ed86-42e5-800a-b05856a62083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbad35f0877045ab85a1f776efe93412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:46Z,use_quota=True,user_id='a45a431be9ad466795e8026ee4a0a1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Creating volume 530b3ca5-ed86-42e5-800a-b05856a62083 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:53 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537b0739-ab89-4963-bd26-c483276b03a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b143b94-c234-4914-8448-f3b3a12c9f4a', 'volume_size': 1, 'source_volid': '0f8cff65-0a44-4eb7-88cf-62b9d18e05d3', 'source_volstatus': 'available'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:53 devstack sudo[87450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083 1073741824
Apr 20 17:33:53 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7333dfca-27a6-4912-b868-eb4c46e08135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:53 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Volume volume-5b143b94-c234-4914-8448-f3b3a12c9f4a (5b143b94-c234-4914-8448-f3b3a12c9f4a): created successfully
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7333dfca-27a6-4912-b868-eb4c46e08135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Flow 'volume_create_manager' (60029b00-9f5c-4707-b5e1-fb05cfa4d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:53 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e654a2b7-ffa6-4721-a3e6-5641f0c19fc6 tempest-VolumeDependencyTests-2106981982 None] Created volume successfully.
Apr 20 17:33:54 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083 1073741824" returned: 0 in 0.483s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:54 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083
Apr 20 17:33:54 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:54 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083" returned: 0 in 0.505s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.190s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:33:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884934459',display_name='tempest-VolumesGetTest-Volume-357704739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3be249-57b1-4109-91a4-cd15b1fe3fdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a679a4abe3b45769d80a7e94880f383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:33:47Z,use_quota=True,user_id='36a19e0016564f68987bd40cc95d8603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Creating volume ca3be249-57b1-4109-91a4-cd15b1fe3fdf {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:33:54 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e1c877-f376-4ba1-bf9f-30b3a47d1fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530b3ca5-ed86-42e5-800a-b05856a62083', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:54 devstack sudo[87483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf 1073741824
Apr 20 17:33:54 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918eb3b3-795c-4801-aa10-155aa8c1d380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:54 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Volume volume-530b3ca5-ed86-42e5-800a-b05856a62083 (530b3ca5-ed86-42e5-800a-b05856a62083): created successfully
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918eb3b3-795c-4801-aa10-155aa8c1d380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Flow 'volume_create_manager' (c6afdf3f-61dd-4f27-869a-00d9eabb1033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:54 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e36162c5-fca1-4016-917e-bd76fecb2d4c tempest-SnapshotMetadataTestJSON-1145036908 None] Created volume successfully.
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" acquired by "delete_volume" :: waited 0.026s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[48475c9d-0ddb-4159-967b-36fb1f2a7b83]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:54 devstack sudo[87487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3
Apr 20 17:33:54 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:55 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf 1073741824" returned: 0 in 0.770s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:55 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" returned: 0 in 0.662s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:55 devstack sudo[87503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf
Apr 20 17:33:55 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:55 devstack sudo[87505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3
Apr 20 17:33:55 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:55 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf" returned: 0 in 0.545s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.092s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Creating offline snapshot 96d582c6-bd18-4d02-9beb-7e71a3aee3f0 of volume 530b3ca5-ed86-42e5-800a-b05856a62083 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff645ab-1813-4ccc-adee-74af8b9cd25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fca9d2-76c2-4254-a91e-bc0830218749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e62e8b-1562-49c5-90b5-31196b0f2b03]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:56 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:56 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Volume volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf (ca3be249-57b1-4109-91a4-cd15b1fe3fdf): created successfully
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fca9d2-76c2-4254-a91e-bc0830218749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Flow 'volume_create_manager' (309a3059-1876-491f-89ad-2891191c6f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" returned: 0 in 0.597s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f427565f-1ae6-4269-852e-5959c08e5293 tempest-VolumesGetTest-992452388 None] Created volume successfully.
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3" released by "delete_volume" :: held 1.315s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Created reservations ['e5639217-4896-4327-8527-d4fe4e339929', '6c281f3e-036d-4274-9b8c-808904f0ffe5', 'cd1abe96-20c4-436f-a3fd-3b9d8e11542f', 'dfe44c52-5762-4ef4-92cb-2f1b9963d3de'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:56 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083
Apr 20 17:33:56 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:56 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:56 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:56 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Deleted volume successfully.
Apr 20 17:33:56 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083" returned: 0 in 0.599s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:56 devstack sudo[87518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 1G
Apr 20 17:33:56 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-81c42559-ae57-4f95-baea-c13b9042d93e tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-0f8cff65-0a44-4eb7-88cf-62b9d18e05d3-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-5b143b94-c234-4914-8448-f3b3a12c9f4a-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-5b143b94-c234-4914-8448-f3b3a12c9f4a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-5b143b94-c234-4914-8448-f3b3a12c9f4a" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-5b143b94-c234-4914-8448-f3b3a12c9f4a" acquired by "delete_volume" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[590808f3-a732-4d73-b427-4f354c9d96a2]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:56 devstack sudo[87520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a
Apr 20 17:33:56 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-ca3be249-57b1-4109-91a4-cd15b1fe3fdf-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Lock "cinder-ca3be249-57b1-4109-91a4-cd15b1fe3fdf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-quobyte-ca3be249-57b1-4109-91a4-cd15b1fe3fdf" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-ca3be249-57b1-4109-91a4-cd15b1fe3fdf" acquired by "delete_volume" :: waited 0.023s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad88ef4b-d79d-479d-be63-2ce9b0a4af49]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:57 devstack sudo[87522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf
Apr 20 17:33:57 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:57 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 1G" returned: 0 in 0.929s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-530b3ca5-ed86-42e5-800a-b05856a62083 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:57 devstack sudo[87530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-530b3ca5-ed86-42e5-800a-b05856a62083 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0
Apr 20 17:33:57 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:57 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a" returned: 0 in 0.863s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:57 devstack sudo[87539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a
Apr 20 17:33:57 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:57 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf" returned: 0 in 0.542s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:57 devstack sudo[87541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf
Apr 20 17:33:57 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:58 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-530b3ca5-ed86-42e5-800a-b05856a62083 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0" returned: 0 in 0.688s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:58 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 is being set with open permissions: ugo+rw
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:58 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5b143b94-c234-4914-8448-f3b3a12c9f4a" returned: 0 in 0.516s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-5b143b94-c234-4914-8448-f3b3a12c9f4a" released by "delete_volume" :: held 1.425s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:58 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0
Apr 20 17:33:58 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Created reservations ['322bb474-6d0d-4905-b581-2cb3e06dc653', '70493591-fc62-4a0a-8d42-acf3504c3c05', '87932929-43f6-414f-b41f-158186b9b43e', 'ee3cfb51-fc1d-46d3-9ae4-0d6f3f0b9884'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:58 devstack sudo[87551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:58 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:58 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ca3be249-57b1-4109-91a4-cd15b1fe3fdf" returned: 0 in 0.572s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-ca3be249-57b1-4109-91a4-cd15b1fe3fdf" released by "delete_volume" :: held 1.148s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Created reservations ['c8cdb148-8d37-417c-a195-d9f45112dd29', '062caf48-31e1-4613-aaa6-794d6fab5a31', '277f6857-7a8b-44e1-b78e-6ca795d7dd83', '621937af-b75e-484e-8dc8-6b4a32ea9ec1'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:58 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:33:58 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:58 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.469s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:58 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Deleted volume successfully.
Apr 20 17:33:58 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0" returned: 0 in 0.610s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0e8155dd-229a-49e5-a997-954c88bf0880 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-5b143b94-c234-4914-8448-f3b3a12c9f4a-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:58 devstack sudo[87561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.info
Apr 20 17:33:58 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-bb9bf310-c2db-4f18-b0bf-05ffab412ff9-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-bb9bf310-c2db-4f18-b0bf-05ffab412ff9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:59 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.643s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:33:59 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Deleted volume successfully.
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65f119ee-bfd6-4830-9ee9-0de8625ac5c7 tempest-VolumesGetTest-992452388 None] Lock "cinder-ca3be249-57b1-4109-91a4-cd15b1fe3fdf-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "cinder-quobyte-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0002224d-fcb8-4938-a3ef-11536bba062c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:59 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9
Apr 20 17:33:59 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:59 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.info" returned: 0 in 0.539s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:59 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.info is being set with open permissions: ugo+rw
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-1c4243ff-2d3a-4488-a10b-24a89ba28144-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Lock "cinder-1c4243ff-2d3a-4488-a10b-24a89ba28144-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:59 devstack sudo[87570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.info
Apr 20 17:33:59 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Acquiring lock "cinder-quobyte-1c4243ff-2d3a-4488-a10b-24a89ba28144" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-1c4243ff-2d3a-4488-a10b-24a89ba28144" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[02373cb0-c6b7-4a24-992d-b040824350a4]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:59 devstack sudo[87572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144
Apr 20 17:33:59 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:59 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" returned: 0 in 0.585s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:33:59 devstack sudo[87577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9
Apr 20 17:33:59 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:33:59 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.info" returned: 0 in 0.502s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:33:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.941s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:33:59 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f8853821-5ea0-4483-830c-1e8a82e3a3d5 tempest-SnapshotMetadataTestJSON-1145036908 None] Create snapshot completed successfully
Apr 20 17:34:00 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144" returned: 0 in 0.590s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:00 devstack sudo[87582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144
Apr 20 17:34:00 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:00 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" returned: 0 in 0.533s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-quobyte-bb9bf310-c2db-4f18-b0bf-05ffab412ff9" released by "delete_volume" :: held 1.142s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Created reservations ['31b7311f-be10-49ca-a57a-263d30e81624', 'b14c0940-fe10-450a-8522-cc50f655bb35', '7cac99c1-b413-4703-be3b-c3f4d7aa7a5c', 'fb81e810-8e39-479d-ac5d-42dab75ab345'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:00 devstack sudo[87585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:00 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Acquiring lock "cinder-96d582c6-bd18-4d02-9beb-7e71a3aee3f0-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-96d582c6-bd18-4d02-9beb-7e71a3aee3f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Acquiring lock "cinder-quobyte-530b3ca5-ed86-42e5-800a-b05856a62083" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-quobyte-530b3ca5-ed86-42e5-800a-b05856a62083" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Acquiring lock "cinder-quobyte-96d582c6-bd18-4d02-9beb-7e71a3aee3f0" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-quobyte-96d582c6-bd18-4d02-9beb-7e71a3aee3f0" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Deleting offline snapshot 96d582c6-bd18-4d02-9beb-7e71a3aee3f0 of volume 530b3ca5-ed86-42e5-800a-b05856a62083 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] snapshot_file for this snap is: volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbad293-1990-43c4-b4e2-a47e4de8ec39]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:00 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144" returned: 1 in 0.672s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:00 devstack sudo[87588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0
Apr 20 17:34:00 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:00 devstack sudo[87591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144
Apr 20 17:34:00 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:00 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.562s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:00 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Deleted volume successfully.
Apr 20 17:34:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-15bccad2-6187-4f07-88b7-f3f601d40e15 tempest-VolumeDependencyTests-2106981982 None] Lock "cinder-bb9bf310-c2db-4f18-b0bf-05ffab412ff9-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:01 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0" returned: 0 in 0.549s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-530b3ca5-ed86-42e5-800a-b05856a62083(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4218d9dd-f172-492e-a4c8-44a3da6ee74f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:01 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1c4243ff-2d3a-4488-a10b-24a89ba28144" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Lock "cinder-quobyte-1c4243ff-2d3a-4488-a10b-24a89ba28144" released by "delete_volume" :: held 1.776s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Created reservations ['2258b67a-47a2-4d9e-98f0-fbcff5550cee', 'eacdf47f-4ee2-4ed7-b47e-584d666f7027', '8e356acf-dd94-4a3a-9960-c20c336bf37b', '9ef3d5d7-500e-41f2-8e58-9e63af1806aa'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:01 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083
Apr 20 17:34:01 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:01 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:01 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:01 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083" returned: 0 in 0.579s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:01 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0
Apr 20 17:34:01 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:02 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.673s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:02 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:02 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Deleted volume successfully.
Apr 20 17:34:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-36e9915f-9ae8-42a7-ace8-16565f810082 tempest-VolumesGetTest-992452388 None] Lock "cinder-1c4243ff-2d3a-4488-a10b-24a89ba28144-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:02 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0" returned: 0 in 0.891s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:02 devstack sudo[87646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0
Apr 20 17:34:02 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:03 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083.96d582c6-bd18-4d02-9beb-7e71a3aee3f0" returned: 0 in 0.721s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-quobyte-96d582c6-bd18-4d02-9beb-7e71a3aee3f0" released by "_delete_snapshot" :: held 2.802s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-quobyte-530b3ca5-ed86-42e5-800a-b05856a62083" released by "delete_snapshot" :: held 2.815s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Created reservations ['b1ad6bd4-9bbe-4364-b954-ca062e9dd2a4', 'db998d8b-4d4e-4a62-991f-1f04af857f7e', 'e768b94a-4819-4a73-9431-78fb99616b4e', '1606ccf0-ec97-4aa5-a4a2-680bb74358c5'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:03 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Delete snapshot completed successfully.
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-65cedea2-6f07-45fb-be34-6de54507cbac tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-96d582c6-bd18-4d02-9beb-7e71a3aee3f0-delete_snapshot" released by "delete_snapshot" :: held 2.908s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Acquiring lock "cinder-530b3ca5-ed86-42e5-800a-b05856a62083-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-530b3ca5-ed86-42e5-800a-b05856a62083-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Acquiring lock "cinder-quobyte-530b3ca5-ed86-42e5-800a-b05856a62083" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-quobyte-530b3ca5-ed86-42e5-800a-b05856a62083" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c915bc0-a1a0-4e87-9979-a3676d287636]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:04 devstack sudo[87649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083
Apr 20 17:34:04 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Flow 'volume_create_manager' (192ed623-2e3a-47d1-932b-21529de18ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c55ea74-88dc-42f1-b8b3-34e543a4389a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c55ea74-88dc-42f1-b8b3-34e543a4389a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2103853005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6b0c42-a2bc-476a-8d33-bb77970188b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a76616775c64698ac358fd3036cf913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:04Z,use_quota=True,user_id='d0cb6e1236214355b679f3d8a26c7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73709da6-4352-4bdd-9311-0aa4b16bbcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73709da6-4352-4bdd-9311-0aa4b16bbcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a9cbad-0037-4fbc-a75f-5aafa8368eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a9cbad-0037-4fbc-a75f-5aafa8368eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6b0c42-a2bc-476a-8d33-bb77970188b2', 'volume_name': 'volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67b7117-ca1f-434a-b162-729a3cf1018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67b7117-ca1f-434a-b162-729a3cf1018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5aeac3c-b811-49b8-90a4-f035cb5dceda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:04 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Volume 0c6b0c42-a2bc-476a-8d33-bb77970188b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2', 'volume_size': 1}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2103853005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6b0c42-a2bc-476a-8d33-bb77970188b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a76616775c64698ac358fd3036cf913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:04Z,use_quota=True,user_id='d0cb6e1236214355b679f3d8a26c7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Creating volume 0c6b0c42-a2bc-476a-8d33-bb77970188b2 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:04 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:04 devstack sudo[87651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2 1073741824
Apr 20 17:34:04 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:04 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083" returned: 0 in 0.697s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:04 devstack sudo[87656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083
Apr 20 17:34:04 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:05 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-530b3ca5-ed86-42e5-800a-b05856a62083" returned: 0 in 0.503s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-quobyte-530b3ca5-ed86-42e5-800a-b05856a62083" released by "delete_volume" :: held 1.240s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Created reservations ['ac1b59ed-b596-49a8-aa2c-aeb967108bac', 'aea5b1c4-dde3-4a0b-a09a-85841db16d9b', '9b85f79b-7771-423a-bf03-3bd023d9dab8', '92cc82ef-dd34-4e96-b800-67bc33245752'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:05 devstack sudo[87662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:05 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:05 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2 1073741824" returned: 0 in 0.886s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:05 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2
Apr 20 17:34:05 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:05 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2" returned: 0 in 0.486s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5aeac3c-b811-49b8-90a4-f035cb5dceda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:05 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8731bf5-47bd-4dce-ae9a-83a2d4726a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.613s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:05 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Volume volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2 (0c6b0c42-a2bc-476a-8d33-bb77970188b2): created successfully
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8731bf5-47bd-4dce-ae9a-83a2d4726a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Flow 'volume_create_manager' (192ed623-2e3a-47d1-932b-21529de18ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:05 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Deleted volume successfully.
Apr 20 17:34:05 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-5c5e764c-82d1-4f14-b74d-f88db9a99a9b tempest-VolumesListTestJSON-1791717461 None] Created volume successfully.
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7eddf5c2-37e4-4c47-91a9-6cca63295ea3 tempest-SnapshotMetadataTestJSON-1145036908 None] Lock "cinder-530b3ca5-ed86-42e5-800a-b05856a62083-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Flow 'volume_create_manager' (e2802721-218e-4c7e-8d98-2b73c2d0f377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608e5709-f5eb-47a4-9ed1-27d97a255c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608e5709-f5eb-47a4-9ed1-27d97a255c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1990606192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc158dc-d416-4db3-a828-35ea49796af5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a76616775c64698ac358fd3036cf913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:07Z,use_quota=True,user_id='d0cb6e1236214355b679f3d8a26c7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16edcb5a-1d16-44b0-a08b-10f408a57d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16edcb5a-1d16-44b0-a08b-10f408a57d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e6718c-fc5e-40c6-a31f-d97600c2307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e6718c-fc5e-40c6-a31f-d97600c2307e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cc158dc-d416-4db3-a828-35ea49796af5', 'volume_name': 'volume-4cc158dc-d416-4db3-a828-35ea49796af5', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5706a0a8-1c70-4bf3-bc10-25ad3c589ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5706a0a8-1c70-4bf3-bc10-25ad3c589ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6ed43d-3d09-4b3b-b2b9-d4bef932a3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:06 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Volume 4cc158dc-d416-4db3-a828-35ea49796af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cc158dc-d416-4db3-a828-35ea49796af5', 'volume_size': 1}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1990606192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cc158dc-d416-4db3-a828-35ea49796af5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a76616775c64698ac358fd3036cf913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:07Z,use_quota=True,user_id='d0cb6e1236214355b679f3d8a26c7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Creating volume 4cc158dc-d416-4db3-a828-35ea49796af5 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:06 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:06 devstack sudo[87670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5 1073741824
Apr 20 17:34:06 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:07 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5 1073741824" returned: 0 in 0.840s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:07 devstack sudo[87690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5
Apr 20 17:34:07 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:08 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5" returned: 0 in 0.960s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6ed43d-3d09-4b3b-b2b9-d4bef932a3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cc158dc-d416-4db3-a828-35ea49796af5', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5261bd-0182-47aa-9555-86cb75da8f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:08 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Volume volume-4cc158dc-d416-4db3-a828-35ea49796af5 (4cc158dc-d416-4db3-a828-35ea49796af5): created successfully
Apr 20 17:34:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5261bd-0182-47aa-9555-86cb75da8f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Flow 'volume_create_manager' (e2802721-218e-4c7e-8d98-2b73c2d0f377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:08 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-76107106-49b3-4480-9771-8c9bd8a8215e tempest-VolumesListTestJSON-1791717461 None] Created volume successfully.
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Flow 'volume_create_manager' (ea663fbe-3eb7-43df-a74e-8ab7b4dd7ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c24464-b49e-477a-9bf7-75f6004469d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c24464-b49e-477a-9bf7-75f6004469d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1535772577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9eaa7d-23dd-4786-9b5e-a1b0b0967999,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a76616775c64698ac358fd3036cf913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:09Z,use_quota=True,user_id='d0cb6e1236214355b679f3d8a26c7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b4014d-c6e2-4e53-8784-76086fcddb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b4014d-c6e2-4e53-8784-76086fcddb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f837ee9f-a2ac-4a36-a53c-d3a88a35c867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f837ee9f-a2ac-4a36-a53c-d3a88a35c867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9eaa7d-23dd-4786-9b5e-a1b0b0967999', 'volume_name': 'volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f15d6e-d008-4e8b-bf44-57a00568bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f15d6e-d008-4e8b-bf44-57a00568bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1649869-fb4a-42a2-ba74-d8f9b33c6560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Volume eb9eaa7d-23dd-4786-9b5e-a1b0b0967999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999', 'volume_size': 1}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1535772577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9eaa7d-23dd-4786-9b5e-a1b0b0967999,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a76616775c64698ac358fd3036cf913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:09Z,use_quota=True,user_id='d0cb6e1236214355b679f3d8a26c7930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Creating volume eb9eaa7d-23dd-4786-9b5e-a1b0b0967999 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:09 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:09 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999 1073741824
Apr 20 17:34:09 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Flow 'volume_create_manager' (bfc31f7f-bc4e-47c7-82d4-f294b60d29e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5302e546-8284-4d03-88b1-edf937107e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5302e546-8284-4d03-88b1-edf937107e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1948225827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462aed2a-03b5-46d4-9305-52a3bd88c1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5baf01ad2491ba50a5569205c7f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:10Z,use_quota=True,user_id='825710bdd4764f25bcf97970add09623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d2a7fd-d4fc-4313-af21-325518c088b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d2a7fd-d4fc-4313-af21-325518c088b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bf7c88-45d7-4e28-a2f0-3fa8ca0380d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bf7c88-45d7-4e28-a2f0-3fa8ca0380d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462aed2a-03b5-46d4-9305-52a3bd88c1fa', 'volume_name': 'volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82ca8f7-dabc-496d-a763-8d9291a22da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82ca8f7-dabc-496d-a763-8d9291a22da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18c55e2-f337-40a6-adae-d1b5b345aefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:09 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Volume 462aed2a-03b5-46d4-9305-52a3bd88c1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa', 'volume_size': 1}
Apr 20 17:34:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:10 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999 1073741824" returned: 0 in 0.720s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:10 devstack sudo[87698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999
Apr 20 17:34:10 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:10 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999" returned: 0 in 0.607s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1948225827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=462aed2a-03b5-46d4-9305-52a3bd88c1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5baf01ad2491ba50a5569205c7f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:10Z,use_quota=True,user_id='825710bdd4764f25bcf97970add09623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Creating volume 462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:10 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1649869-fb4a-42a2-ba74-d8f9b33c6560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a065e03-ad33-44f8-829f-b5cb01772470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:11 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa 1073741824
Apr 20 17:34:11 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Volume volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999 (eb9eaa7d-23dd-4786-9b5e-a1b0b0967999): created successfully
Apr 20 17:34:11 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a065e03-ad33-44f8-829f-b5cb01772470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Flow 'volume_create_manager' (ea663fbe-3eb7-43df-a74e-8ab7b4dd7ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:11 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7fa9c780-c470-4ef0-b691-88db5f4fd0ed tempest-VolumesListTestJSON-1791717461 None] Created volume successfully.
Apr 20 17:34:11 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa 1073741824" returned: 0 in 1.007s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:12 devstack sudo[87710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa
Apr 20 17:34:12 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:12 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa" returned: 0 in 0.501s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18c55e2-f337-40a6-adae-d1b5b345aefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fa58e4-17ac-42ec-9c5e-9c15e4332782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:12 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Volume volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa (462aed2a-03b5-46d4-9305-52a3bd88c1fa): created successfully
Apr 20 17:34:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fa58e4-17ac-42ec-9c5e-9c15e4332782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Flow 'volume_create_manager' (bfc31f7f-bc4e-47c7-82d4-f294b60d29e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-bc173521-42cd-4969-a1e5-62232e301882 tempest-VolumesDeleteCascade-2068284697 None] Created volume successfully.
Apr 20 17:34:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Creating offline snapshot 405e91b4-39f2-4256-9279-d142314c01b9 of volume 462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:34:13 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c259ee7-3b37-42cb-bbf7-8a4ff9d641c5]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:13 devstack sudo[87742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa
Apr 20 17:34:13 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "cinder-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "cinder-quobyte-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-quobyte-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999" acquired by "delete_volume" :: waited 0.040s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:14 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa" returned: 0 in 1.552s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:14 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c649da-25b8-4c56-b7c7-1b6c0bad5431]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:14 devstack sudo[87752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 1G
Apr 20 17:34:14 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:15 devstack sudo[87753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999
Apr 20 17:34:15 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:15 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999" returned: 0 in 0.689s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:15 devstack sudo[87768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999
Apr 20 17:34:15 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:15 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 1G" returned: 0 in 1.036s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:15 devstack sudo[87770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9
Apr 20 17:34:15 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:16 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999" returned: 0 in 0.841s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-quobyte-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999" released by "delete_volume" :: held 1.607s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:16 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Created reservations ['61b92d55-65a0-4321-b6b2-a557f6c99962', '4d62c052-4bf0-46b0-b72c-743958410156', '47b4d14f-b203-42ff-af73-15e18864e2a5', '18cb5e7b-672f-45e3-aa0c-05afc9a9c75b'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:16 devstack sudo[87775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:16 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:17 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9" returned: 0 in 1.052s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:17 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 is being set with open permissions: ugo+rw
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:17 devstack sudo[87780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9
Apr 20 17:34:17 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "cinder-4cc158dc-d416-4db3-a828-35ea49796af5-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-4cc158dc-d416-4db3-a828-35ea49796af5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "cinder-quobyte-4cc158dc-d416-4db3-a828-35ea49796af5" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-quobyte-4cc158dc-d416-4db3-a828-35ea49796af5" acquired by "delete_volume" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[64237a27-fbb1-44de-95c5-3fc7f624227a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:17 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.766s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:17 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Deleted volume successfully.
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d84f35a-e0bd-4f1b-bfa3-a2912a3da972 tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-eb9eaa7d-23dd-4786-9b5e-a1b0b0967999-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:17 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5
Apr 20 17:34:17 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:17 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9" returned: 0 in 0.985s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:18 devstack sudo[87806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.info
Apr 20 17:34:18 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:18 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5" returned: 0 in 1.138s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:18 devstack sudo[87811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5
Apr 20 17:34:18 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:18 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.info" returned: 0 in 0.949s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:18 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.info is being set with open permissions: ugo+rw
Apr 20 17:34:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:19 devstack sudo[87815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.info
Apr 20 17:34:19 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:19 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4cc158dc-d416-4db3-a828-35ea49796af5" returned: 0 in 0.794s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-quobyte-4cc158dc-d416-4db3-a828-35ea49796af5" released by "delete_volume" :: held 2.083s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Created reservations ['73d77c91-8c5b-44a4-89c3-f5a7c5dbd249', 'd3653112-45e6-4c98-ba81-15fdd90d0c73', '364910bd-55ae-41fb-b559-13c0cc0219b1', '964abafc-29d9-4a63-bd71-9cfb727b223d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:19 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.info" returned: 0 in 0.548s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.299s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:19 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ca063a5c-58ce-41d6-b5d8-36777f7ff156 tempest-VolumesDeleteCascade-2068284697 None] Create snapshot completed successfully
Apr 20 17:34:19 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:19 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:20 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.532s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:20 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Deleted volume successfully.
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07eb6ddc-8f4f-4302-8faa-f35c04c8930d tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-4cc158dc-d416-4db3-a828-35ea49796af5-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "cinder-0c6b0c42-a2bc-476a-8d33-bb77970188b2-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-0c6b0c42-a2bc-476a-8d33-bb77970188b2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "cinder-quobyte-0c6b0c42-a2bc-476a-8d33-bb77970188b2" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-quobyte-0c6b0c42-a2bc-476a-8d33-bb77970188b2" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[52059767-ecd1-44ca-ac80-4f6c70b8a3bb]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Creating offline snapshot 851d134b-7b3e-4e9f-80a5-815a880eb75a of volume 462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:34:20 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2
Apr 20 17:34:20 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e329c89-ada4-49f2-b65d-9ae03683268a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:20 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9
Apr 20 17:34:20 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:21 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2" returned: 0 in 0.743s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:21 devstack sudo[87833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2
Apr 20 17:34:21 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:21 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9" returned: 0 in 0.594s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:21 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:21 devstack sudo[87835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a 1G
Apr 20 17:34:21 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:21 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0c6b0c42-a2bc-476a-8d33-bb77970188b2" returned: 0 in 0.518s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-quobyte-0c6b0c42-a2bc-476a-8d33-bb77970188b2" released by "delete_volume" :: held 1.299s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Created reservations ['6732b382-9bdc-4ed5-bcbf-a388358ab268', '101d5072-ba9d-4230-83a8-68fc1eaac71e', '6aafa811-7d9f-4d81-847d-b981344a7f14', '34985745-fb6f-44d7-b439-71fb8a3e5616'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:22 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:22 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:22 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a 1G" returned: 0 in 0.846s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:22 devstack sudo[87843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a
Apr 20 17:34:22 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:22 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Flow 'volume_create_manager' (25856f43-7012-4f8f-a84f-377e3a54b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356e2956-a15f-4df8-9209-e6c81751b8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.572s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Deleted volume successfully.
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356e2956-a15f-4df8-9209-e6c81751b8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-372922744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96171c8c-50ef-41b8-8b9d-1e8b60297bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aee55c7598a475eb01f834be5548612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:23Z,use_quota=True,user_id='90ab5e1d8fed4392b154ac26571c528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec352df4-86de-4e58-a5d2-5c879136eb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec352df4-86de-4e58-a5d2-5c879136eb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b59b37-a8ce-4126-90ca-2bb970d3cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b59b37-a8ce-4126-90ca-2bb970d3cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96171c8c-50ef-41b8-8b9d-1e8b60297bfd', 'volume_name': 'volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5182b74c-f68a-42f5-9ffc-4c0e0ae56f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5182b74c-f68a-42f5-9ffc-4c0e0ae56f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5426a3e4-661d-4f7c-b066-1475f0ced353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:22 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Volume 96171c8c-50ef-41b8-8b9d-1e8b60297bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd', 'volume_size': 1}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-42a25718-1e09-4a44-ac81-2697a5b50560 tempest-VolumesListTestJSON-1791717461 None] Lock "cinder-0c6b0c42-a2bc-476a-8d33-bb77970188b2-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:22 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a" returned: 0 in 0.551s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:22 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a is being set with open permissions: ugo+rw
Apr 20 17:34:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:22 devstack sudo[87849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a
Apr 20 17:34:22 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:23 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a" returned: 0 in 0.443s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-372922744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96171c8c-50ef-41b8-8b9d-1e8b60297bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aee55c7598a475eb01f834be5548612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:23Z,use_quota=True,user_id='90ab5e1d8fed4392b154ac26571c528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Creating volume 96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:23 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:23 devstack sudo[87852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd 1073741824
Apr 20 17:34:23 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:23 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-615222f2-fbeb-4951-ae27-3a4cefaaf920 tempest-VolumesDeleteCascade-2068284697 None] Create snapshot completed successfully
Apr 20 17:34:23 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:24 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Flow 'volume_create_manager' (99fad8eb-52ae-4d46-a9e5-8efabb99dfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7dd42-8109-4593-9d9a-37ad719c423f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7dd42-8109-4593-9d9a-37ad719c423f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-415601846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7097b05-90c7-4973-8b87-931d725de03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779a17b50ec64c81be3b12f1789060c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:24Z,use_quota=True,user_id='c6a656e565fb4d49a66f29811a857b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b9a004-113f-4766-89a8-170d02443d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b9a004-113f-4766-89a8-170d02443d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5508e09f-fbd3-48f6-aa27-4b44e87c8156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5508e09f-fbd3-48f6-aa27-4b44e87c8156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7097b05-90c7-4973-8b87-931d725de03b', 'volume_name': 'volume-f7097b05-90c7-4973-8b87-931d725de03b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62cdbeb-2920-4669-8ac6-3a401be777ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62cdbeb-2920-4669-8ac6-3a401be777ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c1bb49-f0f8-4226-9168-0c58fba3f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:24 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Volume f7097b05-90c7-4973-8b87-931d725de03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7097b05-90c7-4973-8b87-931d725de03b', 'volume_size': 1}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-462aed2a-03b5-46d4-9305-52a3bd88c1fa-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd 1073741824" returned: 0 in 0.686s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-462aed2a-03b5-46d4-9305-52a3bd88c1fa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Performing cascade delete. {{(pid=82690) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 20 17:34:24 devstack sudo[87857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd
Apr 20 17:34:24 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-405e91b4-39f2-4256-9279-d142314c01b9-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-405e91b4-39f2-4256-9279-d142314c01b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-462aed2a-03b5-46d4-9305-52a3bd88c1fa" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-462aed2a-03b5-46d4-9305-52a3bd88c1fa" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-405e91b4-39f2-4256-9279-d142314c01b9" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-405e91b4-39f2-4256-9279-d142314c01b9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Deleting offline snapshot 405e91b4-39f2-4256-9279-d142314c01b9 of volume 462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] snapshot_file for this snap is: volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[16de9460-e960-4651-b006-8773c75e3a7e]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:24 devstack sudo[87859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9
Apr 20 17:34:24 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:24 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.564s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-415601846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7097b05-90c7-4973-8b87-931d725de03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779a17b50ec64c81be3b12f1789060c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:24Z,use_quota=True,user_id='c6a656e565fb4d49a66f29811a857b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Creating volume f7097b05-90c7-4973-8b87-931d725de03b {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:24 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5426a3e4-661d-4f7c-b066-1475f0ced353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b9aa36-ccb9-460d-ae8b-623ba35daa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:24 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b 1073741824
Apr 20 17:34:24 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:24 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Volume volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd (96171c8c-50ef-41b8-8b9d-1e8b60297bfd): created successfully
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b9aa36-ccb9-460d-ae8b-623ba35daa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Flow 'volume_create_manager' (25856f43-7012-4f8f-a84f-377e3a54b934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:24 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-020865da-e29d-4ab2-afc4-9c0c3e23c116 tempest-SnapshotDependencyTests-671194390 None] Created volume successfully.
Apr 20 17:34:24 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9" returned: 0 in 0.611s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8003a7f-aeb7-4485-92e8-aa75273e07f7]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:24 devstack sudo[87867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa
Apr 20 17:34:24 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Flow 'volume_create_manager' (a747023b-7554-422d-81a2-b8f9532e367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162fc11c-efd8-48a6-85c8-315a297ea5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162fc11c-efd8-48a6-85c8-315a297ea5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1883400022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89dcde2a-afe9-4dde-baea-d4ba4610746c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4337ad7a8d4771bc5c2aeb74ca5c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:25Z,use_quota=True,user_id='9cc3ed1de7904396948f8b7a80300fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b50164a-4ccf-4368-9c52-0c5ff95ead37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b50164a-4ccf-4368-9c52-0c5ff95ead37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497276b8-edff-4d2f-b200-9a8c98cb9830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497276b8-edff-4d2f-b200-9a8c98cb9830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89dcde2a-afe9-4dde-baea-d4ba4610746c', 'volume_name': 'volume-89dcde2a-afe9-4dde-baea-d4ba4610746c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075144dd-a9f8-4257-8e78-591026f56f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075144dd-a9f8-4257-8e78-591026f56f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b190276-0778-4320-9ea0-6ff54de37db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:25 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Volume 89dcde2a-afe9-4dde-baea-d4ba4610746c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89dcde2a-afe9-4dde-baea-d4ba4610746c', 'volume_size': 1}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:25 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa" returned: 0 in 0.513s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec8dedf-8b54-437b-889d-f6919c65be08]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:25 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b 1073741824" returned: 0 in 0.748s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:25 devstack sudo[87876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b
Apr 20 17:34:25 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:25 devstack sudo[87875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a
Apr 20 17:34:25 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:25 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b" returned: 0 in 0.417s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1883400022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89dcde2a-afe9-4dde-baea-d4ba4610746c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d4337ad7a8d4771bc5c2aeb74ca5c04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:25Z,use_quota=True,user_id='9cc3ed1de7904396948f8b7a80300fde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Creating volume 89dcde2a-afe9-4dde-baea-d4ba4610746c {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:25 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:25 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c 1073741824
Apr 20 17:34:25 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c1bb49-f0f8-4226-9168-0c58fba3f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7097b05-90c7-4973-8b87-931d725de03b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b0be1f-6a03-4785-b94a-e21ae4e21fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:25 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a" returned: 0 in 0.518s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:25 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Volume volume-f7097b05-90c7-4973-8b87-931d725de03b (f7097b05-90c7-4973-8b87-931d725de03b): created successfully
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b0be1f-6a03-4785-b94a-e21ae4e21fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Flow 'volume_create_manager' (99fad8eb-52ae-4d46-a9e5-8efabb99dfe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab1f7fb-7bff-49da-bc84-9c52690fad69]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:25 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ca8c024a-9751-4fc1-adf5-c97c4b16f95c tempest-ServersNegativeTestJSON-75096095 None] Created volume successfully.
Apr 20 17:34:25 devstack sudo[87885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9
Apr 20 17:34:25 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:26 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c 1073741824" returned: 0 in 0.542s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:26 devstack sudo[87891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c
Apr 20 17:34:26 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:26 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9" returned: 0 in 0.675s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a311256-0507-40d0-954b-af0d162804cc]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:26 devstack sudo[87896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa
Apr 20 17:34:26 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:26 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c" returned: 0 in 0.520s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.743s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Creating offline snapshot 02db3f4c-ba41-4aab-8bc5-359d79231ef4 of volume 96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:34:26 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Flow 'volume_create_manager' (593de5c9-de33-477b-ac36-c5748e38d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5648e0b2-3010-4640-a241-93cb2c691075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b00ca03-ec58-4332-af21-f892afce27ee]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5648e0b2-3010-4640-a241-93cb2c691075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1856754742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cf0ba9-637f-4610-8ad1-cac53ad89a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779a17b50ec64c81be3b12f1789060c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:27Z,use_quota=True,user_id='c6a656e565fb4d49a66f29811a857b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971b1aaf-0aa9-49b9-873e-c08e4c4873f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971b1aaf-0aa9-49b9-873e-c08e4c4873f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86029f1-532c-42da-919e-c77e1a8f379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86029f1-532c-42da-919e-c77e1a8f379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52cf0ba9-637f-4610-8ad1-cac53ad89a21', 'volume_name': 'volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b55dc-5478-41ba-82a4-db4db54f129a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b55dc-5478-41ba-82a4-db4db54f129a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dff13d8-490e-42c0-811d-3e403154657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:27 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Volume 52cf0ba9-637f-4610-8ad1-cac53ad89a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21', 'volume_size': 1}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b190276-0778-4320-9ea0-6ff54de37db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89dcde2a-afe9-4dde-baea-d4ba4610746c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be58acd3-1449-47dc-9c06-2a54d493949e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:27 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Volume volume-89dcde2a-afe9-4dde-baea-d4ba4610746c (89dcde2a-afe9-4dde-baea-d4ba4610746c): created successfully
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be58acd3-1449-47dc-9c06-2a54d493949e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Flow 'volume_create_manager' (a747023b-7554-422d-81a2-b8f9532e367c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:27 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa" returned: 0 in 0.489s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:27 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4731d452-6078-4a81-876a-582d9d8ae7f5 tempest-VolumesNegativeTest-1274422335 None] Created volume successfully.
Apr 20 17:34:27 devstack sudo[87904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9
Apr 20 17:34:27 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:27 devstack sudo[87903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd
Apr 20 17:34:27 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:27 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" returned: 0 in 0.470s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:27 devstack sudo[87913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 1G
Apr 20 17:34:27 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:27 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9" returned: 0 in 0.464s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:27 devstack sudo[87915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9
Apr 20 17:34:27 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:27 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.405e91b4-39f2-4256-9279-d142314c01b9" returned: 0 in 0.431s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a -F qcow2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:28 devstack sudo[87921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a -F qcow2
Apr 20 17:34:28 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:28 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 1G" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:28 devstack sudo[87923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4
Apr 20 17:34:28 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:28 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a -F qcow2" returned: 0 in 0.525s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-405e91b4-39f2-4256-9279-d142314c01b9" released by "_delete_snapshot" :: held 4.324s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-462aed2a-03b5-46d4-9305-52a3bd88c1fa" released by "delete_snapshot" :: held 4.338s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:28 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4" returned: 0 in 0.513s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:28 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 is being set with open permissions: ugo+rw
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:28 devstack sudo[87934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4
Apr 20 17:34:28 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Created reservations ['4f954735-a8a0-4913-b9ed-3fdc84a1113b', '26bb2fd8-993c-4bfc-8fdb-364804880382', '140f748f-452c-4a46-ac22-c75935d222cc', '6ae5d9d3-2c48-4d03-a395-2d78bd9b7aa3'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:28 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Delete snapshot completed successfully.
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-405e91b4-39f2-4256-9279-d142314c01b9-delete_snapshot" released by "delete_snapshot" :: held 4.463s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-851d134b-7b3e-4e9f-80a5-815a880eb75a-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-851d134b-7b3e-4e9f-80a5-815a880eb75a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-462aed2a-03b5-46d4-9305-52a3bd88c1fa" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-462aed2a-03b5-46d4-9305-52a3bd88c1fa" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-851d134b-7b3e-4e9f-80a5-815a880eb75a" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-851d134b-7b3e-4e9f-80a5-815a880eb75a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Deleting offline snapshot 851d134b-7b3e-4e9f-80a5-815a880eb75a of volume 462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] snapshot_file for this snap is: volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2487ab-6883-44cf-ab07-04fcb4c2323a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:28 devstack sudo[87936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a
Apr 20 17:34:28 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:29 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4" returned: 0 in 0.443s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:29 devstack sudo[87939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.info
Apr 20 17:34:29 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:29 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a" returned: 0 in 0.539s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a5d584-dc1b-4c87-9960-4d9247035cbf]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:29 devstack sudo[87945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa
Apr 20 17:34:29 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:29 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.info" returned: 0 in 0.416s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:29 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.info is being set with open permissions: ugo+rw
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:29 devstack sudo[87948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.info
Apr 20 17:34:29 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:29 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa" returned: 0 in 0.539s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:29 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a
Apr 20 17:34:29 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:29 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.info" returned: 0 in 0.396s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.880s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.795s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1856754742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cf0ba9-637f-4610-8ad1-cac53ad89a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='779a17b50ec64c81be3b12f1789060c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:27Z,use_quota=True,user_id='c6a656e565fb4d49a66f29811a857b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Creating volume 52cf0ba9-637f-4610-8ad1-cac53ad89a21 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:29 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:29 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21 1073741824
Apr 20 17:34:29 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:29 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4fccbada-df27-4abe-a3af-bb2a770ee443 tempest-SnapshotDependencyTests-671194390 None] Create snapshot completed successfully
Apr 20 17:34:30 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a" returned: 0 in 0.488s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:30 devstack sudo[87966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a
Apr 20 17:34:30 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:30 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21 1073741824" returned: 0 in 0.481s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:30 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21
Apr 20 17:34:30 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:30 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa.851d134b-7b3e-4e9f-80a5-815a880eb75a" returned: 0 in 0.476s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-851d134b-7b3e-4e9f-80a5-815a880eb75a" released by "_delete_snapshot" :: held 2.097s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-462aed2a-03b5-46d4-9305-52a3bd88c1fa" released by "delete_snapshot" :: held 2.113s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:30 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21" returned: 0 in 0.490s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Flow 'volume_create_manager' (ff9cc10a-2b95-43df-a2a3-ea51df938137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bc056e-b772-4441-8d03-92c433c0ba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03bc056e-b772-4441-8d03-92c433c0ba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4b87eb-fd37-415d-ad5d-bd89352f21c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aee55c7598a475eb01f834be5548612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02db3f4c-ba41-4aab-8bc5-359d79231ef4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:31Z,use_quota=True,user_id='90ab5e1d8fed4392b154ac26571c528e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e64e314-4bc5-46b8-9239-fa924987b591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e64e314-4bc5-46b8-9239-fa924987b591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4b9ea3-17b4-4d30-8ed0-431011c4c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4b9ea3-17b4-4d30-8ed0-431011c4c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce4b87eb-fd37-415d-ad5d-bd89352f21c1', 'volume_name': 'volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1', 'volume_size': 1, 'snapshot_id': '02db3f4c-ba41-4aab-8bc5-359d79231ef4'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58562695-99cb-45ea-a1da-dac50ba9ee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58562695-99cb-45ea-a1da-dac50ba9ee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787611bf-7d9f-433b-9f0b-8ca232829955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:30 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Volume ce4b87eb-fd37-415d-ad5d-bd89352f21c1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1', 'volume_size': 1, 'snapshot_id': '02db3f4c-ba41-4aab-8bc5-359d79231ef4'}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dff13d8-490e-42c0-811d-3e403154657b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84dd08e8-97ef-4258-b0c7-12412f98d5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Created reservations ['2e0a9027-91bc-46d9-ac40-6c1c43b0ecc1', '9b94145f-921b-4d9a-be03-6412b80b25d3', 'f9b52b78-89ab-4cc0-9a4d-719c6c1a5df2', '3a82170b-8db3-4341-affb-1efc59bc4aa6'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "cinder-quobyte-02db3f4c-ba41-4aab-8bc5-359d79231ef4-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" by "_create_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:30 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Volume volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21 (52cf0ba9-637f-4610-8ad1-cac53ad89a21): created successfully
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84dd08e8-97ef-4258-b0c7-12412f98d5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Flow 'volume_create_manager' (593de5c9-de33-477b-ac36-c5748e38d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:30 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-200d298d-49b9-4285-9aea-d0561f3a9170 tempest-ServersNegativeTestJSON-75096095 None] Created volume successfully.
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-02db3f4c-ba41-4aab-8bc5-359d79231ef4-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Creating volume ce4b87eb-fd37-415d-ad5d-bd89352f21c1 from snapshot 02db3f4c-ba41-4aab-8bc5-359d79231ef4 {{(pid=82690) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "cinder-quobyte-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] snapshot: 02db3f4c-ba41-4aab-8bc5-359d79231ef4, volume: ce4b87eb-fd37-415d-ad5d-bd89352f21c1,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:34:30 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Delete snapshot completed successfully.
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-851d134b-7b3e-4e9f-80a5-815a880eb75a-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Snapshots deleted, issuing volume delete {{(pid=82690) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-462aed2a-03b5-46d4-9305-52a3bd88c1fa" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c483fd-363b-456e-86a5-48903feebe3a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-462aed2a-03b5-46d4-9305-52a3bd88c1fa" acquired by "delete_volume" :: waited 0.019s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cce2bb-7921-42b1-bd83-0ad6624d13d3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:31 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4
Apr 20 17:34:31 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:31 devstack sudo[87973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa
Apr 20 17:34:31 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "cinder-52cf0ba9-637f-4610-8ad1-cac53ad89a21-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Lock "cinder-52cf0ba9-637f-4610-8ad1-cac53ad89a21-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "cinder-quobyte-52cf0ba9-637f-4610-8ad1-cac53ad89a21" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:31 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4" returned: 0 in 0.543s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[2828006a-fe62-4618-b0a3-855b07513b87]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Lock "cinder-quobyte-52cf0ba9-637f-4610-8ad1-cac53ad89a21" acquired by "delete_volume" :: waited 0.022s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2fbbba-9dd5-4cba-abc2-f34ea07af423]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:31 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa" returned: 0 in 0.571s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:31 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa
Apr 20 17:34:31 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd
Apr 20 17:34:31 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:31 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:31 devstack sudo[87983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21
Apr 20 17:34:31 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:32 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-462aed2a-03b5-46d4-9305-52a3bd88c1fa" returned: 0 in 0.429s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-462aed2a-03b5-46d4-9305-52a3bd88c1fa" released by "delete_volume" :: held 1.026s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:32 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" returned: 0 in 0.501s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1 not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:32 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1
Apr 20 17:34:32 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Created reservations ['135161b7-0257-4f46-93fd-c62fff588216', '7734e6d8-6473-4d05-9a32-bf1c0392e7ad', '0d63a048-f466-4c08-b4cc-e3426208871b', 'b4e3c9da-3cae-4fa6-a393-b361206935d9'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:32 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21" returned: 0 in 0.559s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:32 devstack sudo[87997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:32 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:32 devstack sudo[87998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21
Apr 20 17:34:32 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:32 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.543s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:32 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Deleted volume successfully.
Apr 20 17:34:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42ea060-6888-4be5-938b-8a5fe98693c3 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-462aed2a-03b5-46d4-9305-52a3bd88c1fa-delete_volume" released by "delete_volume" :: held 8.635s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:33 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52cf0ba9-637f-4610-8ad1-cac53ad89a21" returned: 0 in 1.025s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Lock "cinder-quobyte-52cf0ba9-637f-4610-8ad1-cac53ad89a21" released by "delete_volume" :: held 1.640s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Created reservations ['ec4dec5b-1435-4bb3-ab9a-62d26659a777', '3b50f48a-8ec0-4e78-a1b6-0257d45c83a7', 'c090f41c-c6c0-4bb8-a85c-c699ba764440', 'e7a1b7ff-a950-4f25-97e6-11395b1e8e39'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Flow 'volume_create_manager' (f78597aa-e3cb-4766-b291-a58a187bea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b865481e-f3c6-4d5e-9f80-d6936449e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b865481e-f3c6-4d5e-9f80-d6936449e770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1345811310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724deb59-adef-456b-a40a-b7a0e62e4cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5baf01ad2491ba50a5569205c7f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:34Z,use_quota=True,user_id='825710bdd4764f25bcf97970add09623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0ca685-f6ab-46f7-803a-96ffb7989c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0ca685-f6ab-46f7-803a-96ffb7989c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:34 devstack sudo[88014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:34 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e5f3f1-f0aa-4223-8ddd-547a1cba715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e5f3f1-f0aa-4223-8ddd-547a1cba715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724deb59-adef-456b-a40a-b7a0e62e4cf2', 'volume_name': 'volume-724deb59-adef-456b-a40a-b7a0e62e4cf2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c187ca-e541-4812-9f37-e15427156785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c187ca-e541-4812-9f37-e15427156785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfff9ce-1d6f-41d0-82d6-b5744ab45a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:34 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Volume 724deb59-adef-456b-a40a-b7a0e62e4cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724deb59-adef-456b-a40a-b7a0e62e4cf2', 'volume_size': 1}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "cinder-f7097b05-90c7-4973-8b87-931d725de03b-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Lock "cinder-f7097b05-90c7-4973-8b87-931d725de03b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "cinder-quobyte-f7097b05-90c7-4973-8b87-931d725de03b" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Lock "cinder-quobyte-f7097b05-90c7-4973-8b87-931d725de03b" acquired by "delete_volume" :: waited 0.047s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[60befb25-04bb-4e6e-bb71-a33e8306c153]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:34 devstack sudo[88017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b
Apr 20 17:34:34 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:35 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" returned: 0 in 3.017s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfb051c-ac49-434e-8f4d-a8f112e62b5b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:35 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 1.346s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Deleted volume successfully.
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-475db046-33ff-45c7-b774-c84418a241b0 tempest-ServersNegativeTestJSON-75096095 None] Lock "cinder-52cf0ba9-637f-4610-8ad1-cac53ad89a21-delete_volume" released by "delete_volume" :: held 3.681s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:35 devstack sudo[88023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd
Apr 20 17:34:35 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:35 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b" returned: 0 in 0.954s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:35 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b
Apr 20 17:34:35 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:35 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" returned: 0 in 0.714s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd, size 1024.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:34:35 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Converted 1024.00 MB image at 339.27 MB/s
Apr 20 17:34:35 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1 is being set with open permissions: ugo+rw
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:35 devstack sudo[88046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1
Apr 20 17:34:35 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:35 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f7097b05-90c7-4973-8b87-931d725de03b" returned: 0 in 0.521s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Lock "cinder-quobyte-f7097b05-90c7-4973-8b87-931d725de03b" released by "delete_volume" :: held 1.527s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Created reservations ['8d119610-e790-4028-9d1c-fd31b7ef2358', 'c03f96da-9339-47a2-818e-ee70b1eba208', 'c9ef4111-0421-4f3c-82a6-d87fdae1d0f0', 'e7eae480-6390-49ed-ad9a-fe7110f80558'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:35 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:35 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:36 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" returned: 0 in 0.465s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" released by "_copy_volume_from_snapshot" :: held 5.295s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-02db3f4c-ba41-4aab-8bc5-359d79231ef4-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" released by "_create_volume_from_snapshot" :: held 5.330s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.357s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.170s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1345811310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724deb59-adef-456b-a40a-b7a0e62e4cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5baf01ad2491ba50a5569205c7f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:34Z,use_quota=True,user_id='825710bdd4764f25bcf97970add09623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Creating volume 724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:36 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:36 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 1073741824
Apr 20 17:34:36 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787611bf-7d9f-433b-9f0b-8ca232829955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1', 'volume_size': 1, 'snapshot_id': '02db3f4c-ba41-4aab-8bc5-359d79231ef4'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f768c80f-bb82-4fcc-9839-e0ed526b76dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:36 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Volume volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1 (ce4b87eb-fd37-415d-ad5d-bd89352f21c1): created successfully
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f768c80f-bb82-4fcc-9839-e0ed526b76dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Flow 'volume_create_manager' (ff9cc10a-2b95-43df-a2a3-ea51df938137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:36 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-fea4a098-77b3-41e0-b350-1d922626da49 tempest-SnapshotDependencyTests-671194390 None] Created volume successfully.
Apr 20 17:34:36 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.466s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:36 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Deleted volume successfully.
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9836c0fe-5286-445c-a6f7-5347658f7c59 tempest-ServersNegativeTestJSON-75096095 None] Lock "cinder-f7097b05-90c7-4973-8b87-931d725de03b-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "cinder-02db3f4c-ba41-4aab-8bc5-359d79231ef4-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-02db3f4c-ba41-4aab-8bc5-359d79231ef4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "cinder-quobyte-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "cinder-quobyte-02db3f4c-ba41-4aab-8bc5-359d79231ef4" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-02db3f4c-ba41-4aab-8bc5-359d79231ef4" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Deleting offline snapshot 02db3f4c-ba41-4aab-8bc5-359d79231ef4 of volume 96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] snapshot_file for this snap is: volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28ae8c6-9eb3-41e8-aa0d-88fcb8bb4050]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:36 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4
Apr 20 17:34:36 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:36 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 1073741824" returned: 0 in 0.647s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:36 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2
Apr 20 17:34:36 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:37 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4" returned: 0 in 0.552s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df6adfe-109d-4268-99a7-bfb349098d8d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:37 devstack sudo[88067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd
Apr 20 17:34:37 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:37 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2" returned: 0 in 0.447s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cfff9ce-1d6f-41d0-82d6-b5744ab45a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724deb59-adef-456b-a40a-b7a0e62e4cf2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2744a79-381d-43bf-b237-f594c52aaae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:37 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Volume volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 (724deb59-adef-456b-a40a-b7a0e62e4cf2): created successfully
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2744a79-381d-43bf-b237-f594c52aaae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Flow 'volume_create_manager' (f78597aa-e3cb-4766-b291-a58a187bea29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-55b368fc-ab2b-4856-afd6-ef4685198f57 tempest-VolumesDeleteCascade-2068284697 None] Created volume successfully.
Apr 20 17:34:37 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" returned: 0 in 0.508s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:37 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4
Apr 20 17:34:37 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:38 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4" returned: 0 in 0.646s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:38 devstack sudo[88106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4
Apr 20 17:34:38 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Creating offline snapshot cd3f8cee-88ff-4878-9130-75dbe4240aad of volume 724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc584ef-d4c8-49b8-817f-52f628a7a56d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:38 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2
Apr 20 17:34:38 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:38 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd.02db3f4c-ba41-4aab-8bc5-359d79231ef4" returned: 0 in 0.460s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-02db3f4c-ba41-4aab-8bc5-359d79231ef4" released by "_delete_snapshot" :: held 2.238s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" released by "delete_snapshot" :: held 2.250s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Created reservations ['c9f9b432-d505-4de7-a95c-fbefee9cf643', '8495c8be-06cb-4646-9f5e-1f48b045153c', '12fcced9-22d0-4587-8bc9-b41146f0ba7c', '47ac54cb-6674-4cb8-a61b-47be94d6dc58'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:38 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2" returned: 0 in 0.496s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:38 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Delete snapshot completed successfully.
Apr 20 17:34:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-766dff17-b2f5-4e1d-aad4-f231d49001ec tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-02db3f4c-ba41-4aab-8bc5-359d79231ef4-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:38 devstack sudo[88115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad 1G
Apr 20 17:34:38 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:39 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad 1G" returned: 0 in 0.584s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:39 devstack sudo[88124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad
Apr 20 17:34:39 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "cinder-96171c8c-50ef-41b8-8b9d-1e8b60297bfd-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-96171c8c-50ef-41b8-8b9d-1e8b60297bfd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "cinder-quobyte-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97a5878-f328-469c-bf6f-77ce7772c00d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:39 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:39 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad" returned: 0 in 0.445s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:39 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:39 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad is being set with open permissions: ugo+rw
Apr 20 17:34:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:39 devstack sudo[88131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad
Apr 20 17:34:39 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:40 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" returned: 0 in 0.476s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:40 devstack sudo[88137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd
Apr 20 17:34:40 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:40 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad" returned: 0 in 0.438s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:40 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.info
Apr 20 17:34:40 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:40 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" returned: 0 in 0.478s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-96171c8c-50ef-41b8-8b9d-1e8b60297bfd" released by "delete_volume" :: held 1.044s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Created reservations ['e771944f-4cab-41e7-b04c-69b500682590', '2a360e37-1663-4d37-8d85-20d31af522b7', 'c4285374-486f-403c-adce-6bd08ca42f39', 'c0a2b08a-289a-44e1-8354-5878756bb386'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:40 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:40 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:40 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.info" returned: 0 in 0.643s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:40 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.info is being set with open permissions: ugo+rw
Apr 20 17:34:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:41 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.info
Apr 20 17:34:41 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:41 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.info" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.143s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:41 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-1fdd8dd2-ec7a-4f10-8290-7e31be7fe463 tempest-VolumesDeleteCascade-2068284697 None] Create snapshot completed successfully
Apr 20 17:34:41 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.572s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:41 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:41 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Deleted volume successfully.
Apr 20 17:34:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-892ca1f5-e8d0-43c3-a74e-31007dd3d582 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-96171c8c-50ef-41b8-8b9d-1e8b60297bfd-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "cinder-ce4b87eb-fd37-415d-ad5d-bd89352f21c1-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-ce4b87eb-fd37-415d-ad5d-bd89352f21c1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "cinder-quobyte-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d93bf69-4f17-44c2-926d-1ca3c85f4701]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:42 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1
Apr 20 17:34:42 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:42 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" returned: 0 in 0.551s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:42 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1
Apr 20 17:34:42 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Flow 'volume_create_manager' (c369753e-ad7b-46f1-a41d-c20360f04a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212bbe35-b836-4f4c-9e10-1ebe0cbf46ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212bbe35-b836-4f4c-9e10-1ebe0cbf46ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1160573974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68aaa61c-87a8-4072-87ab-994f18cbea71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a5baf01ad2491ba50a5569205c7f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd3f8cee-88ff-4878-9130-75dbe4240aad,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:43Z,use_quota=True,user_id='825710bdd4764f25bcf97970add09623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f3dcc4-4201-4720-9757-e5e13d682c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f3dcc4-4201-4720-9757-e5e13d682c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411a7c6d-248c-4eba-8dec-2bef89a85776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411a7c6d-248c-4eba-8dec-2bef89a85776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68aaa61c-87a8-4072-87ab-994f18cbea71', 'volume_name': 'volume-68aaa61c-87a8-4072-87ab-994f18cbea71', 'volume_size': 1, 'snapshot_id': 'cd3f8cee-88ff-4878-9130-75dbe4240aad'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4c43ff-b511-4397-b608-325cbb5b9557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4c43ff-b511-4397-b608-325cbb5b9557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9185b88c-d36b-4856-8e1f-a056c722f7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:43 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Volume 68aaa61c-87a8-4072-87ab-994f18cbea71: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68aaa61c-87a8-4072-87ab-994f18cbea71', 'volume_size': 1, 'snapshot_id': 'cd3f8cee-88ff-4878-9130-75dbe4240aad'}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-cd3f8cee-88ff-4878-9130-75dbe4240aad-68aaa61c-87a8-4072-87ab-994f18cbea71" by "_create_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-cd3f8cee-88ff-4878-9130-75dbe4240aad-68aaa61c-87a8-4072-87ab-994f18cbea71" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Creating volume 68aaa61c-87a8-4072-87ab-994f18cbea71 from snapshot cd3f8cee-88ff-4878-9130-75dbe4240aad {{(pid=82690) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-68aaa61c-87a8-4072-87ab-994f18cbea71" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-68aaa61c-87a8-4072-87ab-994f18cbea71" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] snapshot: cd3f8cee-88ff-4878-9130-75dbe4240aad, volume: 68aaa61c-87a8-4072-87ab-994f18cbea71,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a296a4ed-23fa-495e-9dc2-5201621dc820]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:43 devstack sudo[88184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad
Apr 20 17:34:43 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:43 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:43 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:43 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" returned: 0 in 0.804s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-quobyte-ce4b87eb-fd37-415d-ad5d-bd89352f21c1" released by "delete_volume" :: held 1.386s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Created reservations ['904d5581-5ccd-4056-a1ee-2ead92c66c8e', '5076ab9b-9df0-430f-a4f3-94fc5390ad7e', '03a524eb-f803-443b-beb3-35080c881160', '6a943707-d865-4923-ab11-68794b84af5a'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:43 devstack sudo[88189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:43 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:43 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.593s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:43 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad" returned: 0 in 0.834s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-724deb59-adef-456b-a40a-b7a0e62e4cf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[14da5e44-7838-4ae5-bc59-fe9c5a07b001]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:44 devstack sudo[88195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2
Apr 20 17:34:44 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:44 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.576s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:44 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:44 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Deleted volume successfully.
Apr 20 17:34:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c32768ce-776b-407b-8c29-2a957e858eb8 tempest-SnapshotDependencyTests-671194390 None] Lock "cinder-ce4b87eb-fd37-415d-ad5d-bd89352f21c1-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:44 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2" returned: 0 in 0.590s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:44 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71 not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:34:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:44 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71
Apr 20 17:34:44 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:47 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71" returned: 0 in 3.063s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5fba12-2045-44e5-a2c2-5b148f07f21e]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:47 devstack sudo[88246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2
Apr 20 17:34:47 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:48 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2" returned: 0 in 0.855s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:48 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2, size 1024.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:34:48 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Converted 1024.00 MB image at 334.13 MB/s
Apr 20 17:34:48 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71 is being set with open permissions: ugo+rw
Apr 20 17:34:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:48 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71
Apr 20 17:34:48 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:49 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71" returned: 0 in 0.557s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-68aaa61c-87a8-4072-87ab-994f18cbea71" released by "_copy_volume_from_snapshot" :: held 5.974s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-cd3f8cee-88ff-4878-9130-75dbe4240aad-68aaa61c-87a8-4072-87ab-994f18cbea71" released by "_create_volume_from_snapshot" :: held 6.005s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.020s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9185b88c-d36b-4856-8e1f-a056c722f7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68aaa61c-87a8-4072-87ab-994f18cbea71', 'volume_size': 1, 'snapshot_id': 'cd3f8cee-88ff-4878-9130-75dbe4240aad'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99f24b5-14a1-447d-87bf-5bb50e7bc30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:49 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Volume volume-68aaa61c-87a8-4072-87ab-994f18cbea71 (68aaa61c-87a8-4072-87ab-994f18cbea71): created successfully
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99f24b5-14a1-447d-87bf-5bb50e7bc30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Flow 'volume_create_manager' (c369753e-ad7b-46f1-a41d-c20360f04a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:49 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f368ae61-dd69-42f4-99a3-2eaf15069bb8 tempest-VolumesDeleteCascade-2068284697 None] Created volume successfully.
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-724deb59-adef-456b-a40a-b7a0e62e4cf2-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-724deb59-adef-456b-a40a-b7a0e62e4cf2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Performing cascade delete. {{(pid=82690) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-cd3f8cee-88ff-4878-9130-75dbe4240aad-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-cd3f8cee-88ff-4878-9130-75dbe4240aad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-724deb59-adef-456b-a40a-b7a0e62e4cf2" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-724deb59-adef-456b-a40a-b7a0e62e4cf2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-cd3f8cee-88ff-4878-9130-75dbe4240aad" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-cd3f8cee-88ff-4878-9130-75dbe4240aad" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Deleting offline snapshot cd3f8cee-88ff-4878-9130-75dbe4240aad of volume 724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] snapshot_file for this snap is: volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f3db39-70cb-413b-86d0-d69add96380d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:49 devstack sudo[88258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad
Apr 20 17:34:49 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Flow 'volume_create_manager' (4b538f4d-8e3a-4715-ae7e-c65f1f77afe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3e289f-e264-449f-8065-879dd07d550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3e289f-e264-449f-8065-879dd07d550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2012171602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3f12d1-8e07-4654-a4c8-a05259ba9865,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf6bda139274c1a8b416d6fd7ca3903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:50Z,use_quota=True,user_id='be8f9a5c948249da9f6903dd87bf6c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da37bfe-2797-46b0-917e-199ceeca3a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da37bfe-2797-46b0-917e-199ceeca3a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbffb8e6-1136-4c78-b3b0-185a2ee0b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbffb8e6-1136-4c78-b3b0-185a2ee0b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3f12d1-8e07-4654-a4c8-a05259ba9865', 'volume_name': 'volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8900962b-a6f1-4587-970e-25d515991803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8900962b-a6f1-4587-970e-25d515991803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc2fe6b-888a-4265-92bc-bd8341f2c9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:49 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Volume 1b3f12d1-8e07-4654-a4c8-a05259ba9865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865', 'volume_size': 1}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2012171602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b3f12d1-8e07-4654-a4c8-a05259ba9865,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf6bda139274c1a8b416d6fd7ca3903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:50Z,use_quota=True,user_id='be8f9a5c948249da9f6903dd87bf6c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Creating volume 1b3f12d1-8e07-4654-a4c8-a05259ba9865 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:49 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:49 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865 1073741824
Apr 20 17:34:49 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:50 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad" returned: 0 in 0.597s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-724deb59-adef-456b-a40a-b7a0e62e4cf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd49e0ee-a2f3-4d51-a7fa-c733489c71ad]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:50 devstack sudo[88268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2
Apr 20 17:34:50 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:50 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865 1073741824" returned: 0 in 0.541s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:50 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865
Apr 20 17:34:50 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:50 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2" returned: 0 in 0.585s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:50 devstack sudo[88277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad
Apr 20 17:34:50 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:50 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865" returned: 0 in 0.490s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc2fe6b-888a-4265-92bc-bd8341f2c9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209d1057-6dd6-4d86-bbb3-fc8a6e3c6e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:50 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Volume volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865 (1b3f12d1-8e07-4654-a4c8-a05259ba9865): created successfully
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209d1057-6dd6-4d86-bbb3-fc8a6e3c6e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Flow 'volume_create_manager' (4b538f4d-8e3a-4715-ae7e-c65f1f77afe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:50 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-cb41c4a3-672e-4477-bec9-c2f68879110a tempest-VolumesTestJSON-315270287 None] Created volume successfully.
Apr 20 17:34:51 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad" returned: 0 in 0.500s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:51 devstack sudo[88282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad
Apr 20 17:34:51 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:51 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2.cd3f8cee-88ff-4878-9130-75dbe4240aad" returned: 0 in 0.466s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-cd3f8cee-88ff-4878-9130-75dbe4240aad" released by "_delete_snapshot" :: held 2.207s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-724deb59-adef-456b-a40a-b7a0e62e4cf2" released by "delete_snapshot" :: held 2.220s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:UPDATE=184,cinder:SELECT=137,cinder:INSERT=38,cinder:DELETE=19 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Created reservations ['9bb269a5-bd0a-4456-93ce-789690dab294', '756bd73e-0695-4d44-aa64-06b769a842de', '9920127e-c6f0-4971-9f0f-61160fcbe548', 'b12638da-8a8c-45fa-90ef-c981d045cbc0'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:51 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Delete snapshot completed successfully.
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-cd3f8cee-88ff-4878-9130-75dbe4240aad-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Snapshots deleted, issuing volume delete {{(pid=82690) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-724deb59-adef-456b-a40a-b7a0e62e4cf2" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-724deb59-adef-456b-a40a-b7a0e62e4cf2" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9d42d8-bb7a-472f-8c7b-1292dde4b214]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:52 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2
Apr 20 17:34:52 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Flow 'volume_create_manager' (82d8c124-b1fd-4809-8d20-6687f5b66446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71cfa75-9a25-48a8-86e4-aed8eadc4cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71cfa75-9a25-48a8-86e4-aed8eadc4cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1558889248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf6bda139274c1a8b416d6fd7ca3903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:52Z,use_quota=True,user_id='be8f9a5c948249da9f6903dd87bf6c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b710489-e580-4f79-a8bf-02e2b01b1f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b710489-e580-4f79-a8bf-02e2b01b1f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7090a5-9aa1-4087-bb97-41544afb72d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7090a5-9aa1-4087-bb97-41544afb72d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c', 'volume_name': 'volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb5b23a-f722-467b-ae96-72e51255c3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb5b23a-f722-467b-ae96-72e51255c3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d7322a-130c-43c2-b473-ca081f104c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:52 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Volume 2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c', 'volume_size': 1}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1558889248',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf6bda139274c1a8b416d6fd7ca3903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:52Z,use_quota=True,user_id='be8f9a5c948249da9f6903dd87bf6c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Creating volume 2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:52 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:52 devstack sudo[88288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c 1073741824
Apr 20 17:34:52 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:52 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2" returned: 0 in 0.628s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:52 devstack sudo[88293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2
Apr 20 17:34:52 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:52 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c 1073741824" returned: 0 in 0.764s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:53 devstack sudo[88298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c
Apr 20 17:34:53 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:53 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-724deb59-adef-456b-a40a-b7a0e62e4cf2" returned: 0 in 0.572s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-724deb59-adef-456b-a40a-b7a0e62e4cf2" released by "delete_volume" :: held 1.230s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Created reservations ['92beef64-fb26-43d1-8eff-9fabeb1e060d', '35499c9c-8a55-42db-9fb3-134fad745f7a', '0577165d-b4ed-4b6c-bc73-ce30c6344566', 'f858ea31-5655-4243-87a4-8f4d435822b6'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:53 devstack sudo[88301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:53 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:53 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c" returned: 0 in 0.526s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d7322a-130c-43c2-b473-ca081f104c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a894ac1-84f2-4876-b6be-736618e96e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:53 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Volume volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c (2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c): created successfully
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a894ac1-84f2-4876-b6be-736618e96e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Flow 'volume_create_manager' (82d8c124-b1fd-4809-8d20-6687f5b66446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:53 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-240cfa0e-72b0-4112-9d7b-d581a50c8c97 tempest-VolumesTestJSON-315270287 None] Created volume successfully.
Apr 20 17:34:53 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.580s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:53 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Deleted volume successfully.
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-58a5ecbe-ff3f-4c5a-be6d-f332332ae912 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-724deb59-adef-456b-a40a-b7a0e62e4cf2-delete_volume" released by "delete_volume" :: held 4.324s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-68aaa61c-87a8-4072-87ab-994f18cbea71-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-68aaa61c-87a8-4072-87ab-994f18cbea71-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:UPDATE=201,cinder:SELECT=158,cinder:INSERT=57,cinder:DELETE=16 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "cinder-quobyte-68aaa61c-87a8-4072-87ab-994f18cbea71" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-68aaa61c-87a8-4072-87ab-994f18cbea71" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5427ae91-0bb7-4d94-9b3c-d7bfac610d75]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:54 devstack sudo[88306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71
Apr 20 17:34:54 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:54 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71" returned: 0 in 0.556s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:54 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71
Apr 20 17:34:54 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Flow 'volume_create_manager' (8f9bd36c-ac3a-4604-9bf5-2190119f6103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44719d28-859b-409d-89aa-89a5a6c3b09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44719d28-859b-409d-89aa-89a5a6c3b09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-489146168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4a2ce0-12e5-4b77-9443-adeb26378830,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf6bda139274c1a8b416d6fd7ca3903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:55Z,use_quota=True,user_id='be8f9a5c948249da9f6903dd87bf6c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0dca2da-e725-4ddb-bf91-5667def38a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0dca2da-e725-4ddb-bf91-5667def38a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e918cd-dfae-4214-b60f-392d263fc289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e918cd-dfae-4214-b60f-392d263fc289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f4a2ce0-12e5-4b77-9443-adeb26378830', 'volume_name': 'volume-6f4a2ce0-12e5-4b77-9443-adeb26378830', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221c3a82-11b7-4b11-9ca9-37edc13350dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221c3a82-11b7-4b11-9ca9-37edc13350dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4588319-ffa4-41e1-8dce-cccde18714c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:54 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Volume 6f4a2ce0-12e5-4b77-9443-adeb26378830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f4a2ce0-12e5-4b77-9443-adeb26378830', 'volume_size': 1}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-489146168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4a2ce0-12e5-4b77-9443-adeb26378830,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf6bda139274c1a8b416d6fd7ca3903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:55Z,use_quota=True,user_id='be8f9a5c948249da9f6903dd87bf6c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Creating volume 6f4a2ce0-12e5-4b77-9443-adeb26378830 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:54 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:54 devstack sudo[88314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830 1073741824
Apr 20 17:34:54 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:54 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-68aaa61c-87a8-4072-87ab-994f18cbea71" returned: 0 in 0.448s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-quobyte-68aaa61c-87a8-4072-87ab-994f18cbea71" released by "delete_volume" :: held 1.034s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:54 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Created reservations ['039e3dd1-239e-4c2d-acf0-8dad8af9e8f7', 'a5ceb4b1-f026-48c9-a149-8a09658efa4f', 'a370bea4-c134-437f-bebd-bace65926abf', 'ba3bee91-7a22-4608-9643-5ae3c67892fb'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:55 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:55 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:55 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830 1073741824" returned: 0 in 0.602s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:55 devstack sudo[88328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830
Apr 20 17:34:55 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:55 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Deleted volume successfully.
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b93241db-2826-4b0e-b681-219accb901d5 tempest-VolumesDeleteCascade-2068284697 None] Lock "cinder-68aaa61c-87a8-4072-87ab-994f18cbea71-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:55 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830" returned: 0 in 0.458s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4588319-ffa4-41e1-8dce-cccde18714c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f4a2ce0-12e5-4b77-9443-adeb26378830', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a57f080-47b2-4792-a727-af0a800bf426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:55 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Volume volume-6f4a2ce0-12e5-4b77-9443-adeb26378830 (6f4a2ce0-12e5-4b77-9443-adeb26378830): created successfully
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a57f080-47b2-4792-a727-af0a800bf426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Flow 'volume_create_manager' (8f9bd36c-ac3a-4604-9bf5-2190119f6103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-68260ac0-41f2-4092-a35f-04363475b325 tempest-VolumesTestJSON-315270287 None] Created volume successfully.
Apr 20 17:34:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Acquiring lock "cinder-89dcde2a-afe9-4dde-baea-d4ba4610746c-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Lock "cinder-89dcde2a-afe9-4dde-baea-d4ba4610746c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Acquiring lock "cinder-quobyte-89dcde2a-afe9-4dde-baea-d4ba4610746c" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Lock "cinder-quobyte-89dcde2a-afe9-4dde-baea-d4ba4610746c" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:56 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[715b44cf-c648-46c8-b66c-ed97e6a30371]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:56 devstack sudo[88333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c
Apr 20 17:34:56 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:57 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c" returned: 0 in 0.641s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:57 devstack sudo[88339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c
Apr 20 17:34:57 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Acquiring lock "cinder-6f4a2ce0-12e5-4b77-9443-adeb26378830-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Lock "cinder-6f4a2ce0-12e5-4b77-9443-adeb26378830-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Acquiring lock "cinder-quobyte-6f4a2ce0-12e5-4b77-9443-adeb26378830" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Lock "cinder-quobyte-6f4a2ce0-12e5-4b77-9443-adeb26378830" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a1d1bb-3bea-4ad2-9273-ae1cdd17914e]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:57 devstack sudo[88341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830
Apr 20 17:34:57 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:57 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-89dcde2a-afe9-4dde-baea-d4ba4610746c" returned: 0 in 0.493s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Lock "cinder-quobyte-89dcde2a-afe9-4dde-baea-d4ba4610746c" released by "delete_volume" :: held 1.161s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Created reservations ['2d676bf5-b8d9-4b8d-87b9-dad7785a0942', '7932dc94-5947-4f5d-85be-21e52078594b', '3753caa2-324f-4aa9-9287-a99c430dfdb2', '2e54ab16-d3e7-420e-8f7c-a20cfa70f961'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:57 devstack sudo[88344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:57 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Flow 'volume_create_manager' (e4122fcd-4c35-44b8-9886-27cc528fae07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e4ae51-8165-4cd4-8655-81b71b78c375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:58 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e4ae51-8165-4cd4-8655-81b71b78c375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-688919749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6256a328f264374a3aa5e72076c67c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:58Z,use_quota=True,user_id='09473cf3f0f54857bd9b9590789ca15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c01145f-843b-413d-a698-404efa710fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c01145f-843b-413d-a698-404efa710fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cfc448-0531-4bc5-b322-ba7290d29514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cfc448-0531-4bc5-b322-ba7290d29514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7', 'volume_name': 'volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356794a5-662c-4d58-9f97-facefa13cead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356794a5-662c-4d58-9f97-facefa13cead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5754b3-336a-4980-b18c-7e79a2570d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:58 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Volume 48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7', 'volume_size': 1}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-688919749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6256a328f264374a3aa5e72076c67c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:34:58Z,use_quota=True,user_id='09473cf3f0f54857bd9b9590789ca15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Creating volume 48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:34:58 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830" returned: 0 in 0.643s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:58 devstack sudo[88349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 1073741824
Apr 20 17:34:58 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:58 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830
Apr 20 17:34:58 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:58 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.409s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:58 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Deleted volume successfully.
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a36f4011-a09e-4098-afea-7c5e11d0182d tempest-VolumesNegativeTest-1274422335 None] Lock "cinder-89dcde2a-afe9-4dde-baea-d4ba4610746c-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:58 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6f4a2ce0-12e5-4b77-9443-adeb26378830" returned: 0 in 0.458s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Lock "cinder-quobyte-6f4a2ce0-12e5-4b77-9443-adeb26378830" released by "delete_volume" :: held 1.129s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Created reservations ['0c183b1a-e334-4635-8a33-735c40c4bd88', '30f479cb-6432-484a-a04f-6ff5c48a605f', '27e4b3f7-1771-4d71-a38e-a00ed0232d35', 'b0344772-e998-44bf-b712-757c9a34b968'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:34:58 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 1073741824" returned: 0 in 0.519s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:58 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7
Apr 20 17:34:58 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:58 devstack sudo[88360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:34:58 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:34:59 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" returned: 0 in 0.472s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:34:59 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5754b3-336a-4980-b18c-7e79a2570d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bfd101-5c30-4674-93c8-56f9c4eb6b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.473s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:34:59 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Deleted volume successfully.
Apr 20 17:34:59 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Volume volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 (48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7): created successfully
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97bfd101-5c30-4674-93c8-56f9c4eb6b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Flow 'volume_create_manager' (e4122fcd-4c35-44b8-9886-27cc528fae07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:34:59 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-00197e14-ac9a-4a3d-b314-7e2c0e0fb56d tempest-VolumesCloneTest-601776915 None] Created volume successfully.
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f61ce0ef-448a-4a86-b2fe-3a672a4e5cae tempest-VolumesTestJSON-315270287 None] Lock "cinder-6f4a2ce0-12e5-4b77-9443-adeb26378830-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Acquiring lock "cinder-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Lock "cinder-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Acquiring lock "cinder-quobyte-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Lock "cinder-quobyte-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc97f6a7-47ea-4361-9246-f3d4a7691732]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:34:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:34:59 devstack sudo[88364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c
Apr 20 17:34:59 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:00 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (7deb6efc-a9be-4030-bee6-a9fe63ccc7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ca55b4-d13a-45c5-87cc-487362e666ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ca55b4-d13a-45c5-87cc-487362e666ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-92505714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959d4f79-4590-4f84-b4b8-c84338ce0121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:00Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c7d5fe-e28d-40c1-9125-db1d6576e12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c7d5fe-e28d-40c1-9125-db1d6576e12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2b7630-0298-4732-bab9-053cf21e65fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2b7630-0298-4732-bab9-053cf21e65fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959d4f79-4590-4f84-b4b8-c84338ce0121', 'volume_name': 'volume-959d4f79-4590-4f84-b4b8-c84338ce0121', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79097ee4-d5bc-4c44-9130-5393ae9b685e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79097ee4-d5bc-4c44-9130-5393ae9b685e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ac2efa-ba58-43c7-a1eb-65e6c4659fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume 959d4f79-4590-4f84-b4b8-c84338ce0121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959d4f79-4590-4f84-b4b8-c84338ce0121', 'volume_size': 1}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-92505714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959d4f79-4590-4f84-b4b8-c84338ce0121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:00Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Creating volume 959d4f79-4590-4f84-b4b8-c84338ce0121 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:00 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c" returned: 0 in 0.604s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:00 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121 1073741824
Apr 20 17:35:00 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:00 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c
Apr 20 17:35:00 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Flow 'volume_create_manager' (20e4740e-53f5-496d-9336-b83c3ffed0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a07e4d3-ff93-4c4d-b8e8-d13160c1cb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a07e4d3-ff93-4c4d-b8e8-d13160c1cb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1113934696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9c0590-664b-4efb-81b6-68d7d3ef33db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6256a328f264374a3aa5e72076c67c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:00Z,use_quota=True,user_id='09473cf3f0f54857bd9b9590789ca15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436e0350-b754-4cc3-b334-d1ea7a32136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436e0350-b754-4cc3-b334-d1ea7a32136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634d3f8d-5dd1-4e1e-964f-5b5d4735a3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634d3f8d-5dd1-4e1e-964f-5b5d4735a3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5a9c0590-664b-4efb-81b6-68d7d3ef33db', 'volume_name': 'volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db', 'volume_size': 2, 'source_volid': '48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7', 'source_volstatus': 'available'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28055fd1-4969-457a-b440-6fb184fb68a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28055fd1-4969-457a-b440-6fb184fb68a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3b0559-56df-43f5-9a7a-c85de588c855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:00 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Volume 5a9c0590-664b-4efb-81b6-68d7d3ef33db: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db', 'volume_size': 2, 'source_volid': '48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7', 'source_volstatus': 'available'}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:00 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c" returned: 0 in 0.448s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Lock "cinder-quobyte-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c" released by "delete_volume" :: held 1.084s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Created reservations ['e0f3b19e-4638-45e2-b25e-cf304a7d568e', '149b4563-c5a5-4b5f-9d89-f48a50d9dd6d', '84fc7ab1-df41-437f-ad8a-186c77a72fb8', '55b3432a-076e-4154-a2f6-d153a36b82a6'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:00 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121 1073741824" returned: 0 in 0.511s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:00 devstack sudo[88377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:00 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:00 devstack sudo[88378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121
Apr 20 17:35:00 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:01 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.401s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:01 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Deleted volume successfully.
Apr 20 17:35:01 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b42cd154-0a73-486c-88d3-9d4855f0875c tempest-VolumesTestJSON-315270287 None] Lock "cinder-2659ea60-de6b-4fc5-8d3a-b0a2b3152a4c-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121" returned: 0 in 0.419s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.698s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:01 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Cloning volume 48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 to volume 5a9c0590-664b-4efb-81b6-68d7d3ef33db
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ac2efa-ba58-43c7-a1eb-65e6c4659fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959d4f79-4590-4f84-b4b8-c84338ce0121', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9347718-7008-4417-ae55-67464253ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Creating offline snapshot 0b30673f-6392-45c4-bd65-bcc87013b585 of volume 48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:35:01 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume volume-959d4f79-4590-4f84-b4b8-c84338ce0121 (959d4f79-4590-4f84-b4b8-c84338ce0121): created successfully
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9347718-7008-4417-ae55-67464253ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (7deb6efc-a9be-4030-bee6-a9fe63ccc7c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a414c7-e73a-4af2-a629-222265e8520f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:01 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a99a0d23-d234-403a-bcd1-39db0e5287c5 tempest-CreateVolumesFromSnapshotTest-816938383 None] Created volume successfully.
Apr 20 17:35:01 devstack sudo[88383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7
Apr 20 17:35:01 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:01 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" returned: 0 in 0.476s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Acquiring lock "cinder-1b3f12d1-8e07-4654-a4c8-a05259ba9865-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:01 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 1G
Apr 20 17:35:01 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Lock "cinder-1b3f12d1-8e07-4654-a4c8-a05259ba9865-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Acquiring lock "cinder-quobyte-1b3f12d1-8e07-4654-a4c8-a05259ba9865" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Lock "cinder-quobyte-1b3f12d1-8e07-4654-a4c8-a05259ba9865" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[81347970-ff3f-4bfd-bf5f-bd8738f8b39f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:01 devstack sudo[88390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865
Apr 20 17:35:01 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:02 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 1G" returned: 0 in 0.520s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:02 devstack sudo[88398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585
Apr 20 17:35:02 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:02 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865" returned: 0 in 0.502s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:02 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865
Apr 20 17:35:02 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:02 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:02 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 is being set with open permissions: ugo+rw
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:02 devstack sudo[88440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585
Apr 20 17:35:02 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:02 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1b3f12d1-8e07-4654-a4c8-a05259ba9865" returned: 0 in 0.470s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Lock "cinder-quobyte-1b3f12d1-8e07-4654-a4c8-a05259ba9865" released by "delete_volume" :: held 0.994s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Created reservations ['5a71c0a0-8950-475f-b10d-902b2273561d', '2035545f-02e4-46f4-a54d-094a53fa633a', '66b52b6c-2210-471d-a740-66ee58fa933a', 'f9deb11b-e191-4627-b86d-8f058e220ed4'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:02 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:02 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:03 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585" returned: 0 in 0.430s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:03 devstack sudo[88446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.info
Apr 20 17:35:03 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:03 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.398s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:03 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:03 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Deleted volume successfully.
Apr 20 17:35:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74fc82ba-a890-4fd3-b403-5a5528c13848 tempest-VolumesTestJSON-315270287 None] Lock "cinder-1b3f12d1-8e07-4654-a4c8-a05259ba9865-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:03 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.info" returned: 0 in 0.424s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:03 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.info is being set with open permissions: ugo+rw
Apr 20 17:35:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:03 devstack sudo[88449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.info
Apr 20 17:35:03 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:04 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.info" returned: 0 in 0.456s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Acquiring lock "cinder-quobyte-5a9c0590-664b-4efb-81b6-68d7d3ef33db" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Lock "cinder-quobyte-5a9c0590-664b-4efb-81b6-68d7d3ef33db" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] snapshot: 0b30673f-6392-45c4-bd65-bcc87013b585, volume: 5a9c0590-664b-4efb-81b6-68d7d3ef33db,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d279c77-de7d-4069-a104-5464741fe3eb]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:04 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585
Apr 20 17:35:04 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:04 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585" returned: 0 in 0.551s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbf2591-c056-4405-b31d-8214a2099ce3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:04 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7
Apr 20 17:35:04 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:05 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" returned: 0 in 0.526s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:05 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:35:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:05 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db
Apr 20 17:35:05 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:07 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db" returned: 0 in 2.221s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:07 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc59d9d8-cbfa-453a-b088-0fc95c731ee6]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:07 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7
Apr 20 17:35:07 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:08 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" returned: 0 in 0.662s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7, size 1024.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:35:08 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Converted 1024.00 MB image at 460.77 MB/s
Apr 20 17:35:08 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db is being set with open permissions: ugo+rw
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:08 devstack sudo[88480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db
Apr 20 17:35:08 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:08 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db" returned: 0 in 0.449s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Lock "cinder-quobyte-5a9c0590-664b-4efb-81b6-68d7d3ef33db" released by "_copy_volume_from_snapshot" :: held 4.457s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Acquiring lock "cinder-quobyte-0b30673f-6392-45c4-bd65-bcc87013b585" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Lock "cinder-quobyte-0b30673f-6392-45c4-bd65-bcc87013b585" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Deleting offline snapshot 0b30673f-6392-45c4-bd65-bcc87013b585 of volume 48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] snapshot_file for this snap is: volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a56a44-03cf-4e33-9222-ab4ff6992563]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:08 devstack sudo[88483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585
Apr 20 17:35:08 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:09 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585" returned: 0 in 0.553s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:35:09 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ba81ae-c7d5-4729-9dbe-2d2df5c66e74]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:09 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7
Apr 20 17:35:09 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:09 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" returned: 0 in 0.513s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:09 devstack sudo[88495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585
Apr 20 17:35:09 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:10 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585" returned: 0 in 0.479s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:10 devstack sudo[88500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585
Apr 20 17:35:10 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:10 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7.0b30673f-6392-45c4-bd65-bcc87013b585" returned: 0 in 0.498s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Lock "cinder-quobyte-0b30673f-6392-45c4-bd65-bcc87013b585" released by "_delete_snapshot" :: held 2.093s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.479s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.222s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3b0559-56df-43f5-9a7a-c85de588c855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db', 'volume_size': 2, 'source_volid': '48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7', 'source_volstatus': 'available'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9951314b-2be1-49c5-a5ce-7ad2710fab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Creating offline snapshot 5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c of volume 959d4f79-4590-4f84-b4b8-c84338ce0121 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:35:10 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Volume volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db (5a9c0590-664b-4efb-81b6-68d7d3ef33db): created successfully
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9951314b-2be1-49c5-a5ce-7ad2710fab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Flow 'volume_create_manager' (20e4740e-53f5-496d-9336-b83c3ffed0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6f01a7-4c5b-45d9-9b13-cd6d26e27023]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8fc0c38b-b978-49bb-8f3c-c9c1ef7604e5 tempest-VolumesCloneTest-601776915 None] Created volume successfully.
Apr 20 17:35:10 devstack sudo[88503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121
Apr 20 17:35:10 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Acquiring lock "cinder-5a9c0590-664b-4efb-81b6-68d7d3ef33db-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Lock "cinder-5a9c0590-664b-4efb-81b6-68d7d3ef33db-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Acquiring lock "cinder-quobyte-5a9c0590-664b-4efb-81b6-68d7d3ef33db" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Lock "cinder-quobyte-5a9c0590-664b-4efb-81b6-68d7d3ef33db" acquired by "delete_volume" :: waited 0.019s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf3d804-1613-4a5b-8ffa-ffe1827c18ea]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:11 devstack sudo[88508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db
Apr 20 17:35:11 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:11 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121" returned: 0 in 0.587s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:11 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c 1G
Apr 20 17:35:11 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:11 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db" returned: 0 in 0.581s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:11 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db
Apr 20 17:35:11 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:11 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c 1G" returned: 0 in 0.505s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959d4f79-4590-4f84-b4b8-c84338ce0121 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:11 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959d4f79-4590-4f84-b4b8-c84338ce0121 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c
Apr 20 17:35:11 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:12 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5a9c0590-664b-4efb-81b6-68d7d3ef33db" returned: 0 in 0.430s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Lock "cinder-quobyte-5a9c0590-664b-4efb-81b6-68d7d3ef33db" released by "delete_volume" :: held 1.047s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Created reservations ['9133bd98-8538-4112-b830-48457957798e', '569e11e0-9fb2-4833-94fc-fd35c4f8f7f9', 'e96374ab-8392-4a3d-9d75-958db27d3546', 'b83e7ce3-a7ce-4109-9283-c666b9189b39'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:12 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:12 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:12 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-959d4f79-4590-4f84-b4b8-c84338ce0121 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c" returned: 0 in 0.536s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:12 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c is being set with open permissions: ugo+rw
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:12 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c
Apr 20 17:35:12 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Flow 'volume_create_manager' (d1d41a6a-9ed0-412b-9bbb-4a402df55dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42128f7d-7a53-4fce-af1a-02c315955ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42128f7d-7a53-4fce-af1a-02c315955ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1855928805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d4a77f-88a1-4273-85fd-791cf7e46041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31b642aa1e04accbe697d4af84cbb73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:12Z,use_quota=True,user_id='c9891fc36af845fa94a7888e8f5a6043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d884e034-a404-434f-ab77-76b2a77adbf5),volume_type_id=d884e034-a404-434f-ab77-76b2a77adbf5)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d348a9-d16d-4739-af29-b50f9c470774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d348a9-d16d-4739-af29-b50f9c470774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f6fb6b-1e91-45ab-96b8-5221c4e2e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f6fb6b-1e91-45ab-96b8-5221c4e2e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d4a77f-88a1-4273-85fd-791cf7e46041', 'volume_name': 'volume-24d4a77f-88a1-4273-85fd-791cf7e46041', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a5dfd4-3dd6-4a16-8dfb-5e9fd43f9038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a5dfd4-3dd6-4a16-8dfb-5e9fd43f9038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc935d69-f670-4d81-8305-e4e1c6f4c67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:12 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Volume 24d4a77f-88a1-4273-85fd-791cf7e46041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d4a77f-88a1-4273-85fd-791cf7e46041', 'volume_size': 1}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:12 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.444s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Deleted volume successfully.
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f230be1a-0967-44bd-b0e5-9e2c29e33cf5 tempest-VolumesCloneTest-601776915 None] Lock "cinder-5a9c0590-664b-4efb-81b6-68d7d3ef33db-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:12 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c" returned: 0 in 0.430s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:12 devstack sudo[88532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.info
Apr 20 17:35:12 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:13 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.info" returned: 0 in 0.399s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:13 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.info is being set with open permissions: ugo+rw
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:13 devstack sudo[88535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.info
Apr 20 17:35:13 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Acquiring lock "cinder-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Lock "cinder-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Acquiring lock "cinder-quobyte-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Lock "cinder-quobyte-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" acquired by "delete_volume" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef49509-353d-4ad1-af24-c955f7d902bb]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:13 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7
Apr 20 17:35:13 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:13 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.info" returned: 0 in 0.437s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.969s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1855928805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d4a77f-88a1-4273-85fd-791cf7e46041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31b642aa1e04accbe697d4af84cbb73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:12Z,use_quota=True,user_id='c9891fc36af845fa94a7888e8f5a6043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d884e034-a404-434f-ab77-76b2a77adbf5),volume_type_id=d884e034-a404-434f-ab77-76b2a77adbf5)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Creating volume 24d4a77f-88a1-4273-85fd-791cf7e46041 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:13 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:13 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-321f7e58-6240-4e40-9492-3263738b781b tempest-CreateVolumesFromSnapshotTest-816938383 None] Create snapshot completed successfully
Apr 20 17:35:13 devstack sudo[88540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041 1073741824
Apr 20 17:35:13 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:13 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" returned: 0 in 0.485s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:13 devstack sudo[88545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7
Apr 20 17:35:13 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:14 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041 1073741824" returned: 0 in 0.491s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:14 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041
Apr 20 17:35:14 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:14 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" returned: 0 in 0.425s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Lock "cinder-quobyte-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7" released by "delete_volume" :: held 0.936s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Created reservations ['95b4ca79-17e4-4095-bf17-20e82a81b8e2', '057f920e-7264-48e5-a900-ac08fbd6eebd', '8e4a8e18-b833-4df8-af79-3fa002d2c516', '8f6c71fd-d539-4706-a811-2d7e4b5e089b'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:14 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:14 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:14 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041" returned: 0 in 0.446s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc935d69-f670-4d81-8305-e4e1c6f4c67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d4a77f-88a1-4273-85fd-791cf7e46041', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795ecd3b-ea19-44e0-bcfb-33f8b42e38b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:14 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Volume volume-24d4a77f-88a1-4273-85fd-791cf7e46041 (24d4a77f-88a1-4273-85fd-791cf7e46041): created successfully
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795ecd3b-ea19-44e0-bcfb-33f8b42e38b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Flow 'volume_create_manager' (d1d41a6a-9ed0-412b-9bbb-4a402df55dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:14 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-578a7bfa-d905-47c9-9e46-d992a00875ca tempest-VolumeTypesAccessTest-836961534 None] Created volume successfully.
Apr 20 17:35:14 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.447s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:14 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Deleted volume successfully.
Apr 20 17:35:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0fa5e02e-8f06-4cb0-9026-ebff87a8fa2b tempest-VolumesCloneTest-601776915 None] Lock "cinder-48ce8d59-c0d2-4f8b-8cb9-f1e2423f84b7-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (97343ee6-9b16-4f7c-bb7b-d4cd96bb5f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c9b8da-8671-45d3-afdc-85d02265dcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c9b8da-8671-45d3-afdc-85d02265dcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-472764925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80d1139-8a1b-4beb-9f4c-6516bf288d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:15Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38386be6-1c38-4266-8a8d-1d025ad3a2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38386be6-1c38-4266-8a8d-1d025ad3a2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d4b3e0-e211-44e6-bafe-8d72954ad715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d4b3e0-e211-44e6-bafe-8d72954ad715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b80d1139-8a1b-4beb-9f4c-6516bf288d90', 'volume_name': 'volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47c6f53-87e0-45b3-9c1c-e9c57f39ace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47c6f53-87e0-45b3-9c1c-e9c57f39ace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c592cc7b-fb80-4844-9279-49b70b40da6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume b80d1139-8a1b-4beb-9f4c-6516bf288d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90', 'volume_size': 1}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-472764925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80d1139-8a1b-4beb-9f4c-6516bf288d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:15Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Creating volume b80d1139-8a1b-4beb-9f4c-6516bf288d90 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:15 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:15 devstack sudo[88558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90 1073741824
Apr 20 17:35:15 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (da3f35db-5650-4928-8307-2a40da0c695a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a24d66e-db26-479d-a605-e82bc6c51fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a24d66e-db26-479d-a605-e82bc6c51fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1608503265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ab6abc-13f7-4b37-87e9-6b509c134856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:15Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8f16e8-f212-4822-9378-420b4766827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8f16e8-f212-4822-9378-420b4766827a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d3c19b-03bc-405b-9bd5-0e0c911739b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d3c19b-03bc-405b-9bd5-0e0c911739b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54ab6abc-13f7-4b37-87e9-6b509c134856', 'volume_name': 'volume-54ab6abc-13f7-4b37-87e9-6b509c134856', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82c9886-69e3-4f87-a3e7-8fa1f91035a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82c9886-69e3-4f87-a3e7-8fa1f91035a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b517db8-f86c-4af8-ae3a-6fc2839edde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume 54ab6abc-13f7-4b37-87e9-6b509c134856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54ab6abc-13f7-4b37-87e9-6b509c134856', 'volume_size': 1}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (4e69fce5-9d24-44a6-a581-585c85fcf582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fe7ea2-daee-4702-9dbe-a5580166ea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fe7ea2-daee-4702-9dbe-a5580166ea04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687678040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fde24ba-b4d6-4856-9cb4-e4233509327d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:15Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3487862-c6f7-4785-9b90-a1e122b8d4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3487862-c6f7-4785-9b90-a1e122b8d4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b7a6ce-60da-4c11-8321-5e83d3f15fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b7a6ce-60da-4c11-8321-5e83d3f15fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fde24ba-b4d6-4856-9cb4-e4233509327d', 'volume_name': 'volume-4fde24ba-b4d6-4856-9cb4-e4233509327d', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996aeaa6-4262-4066-9531-e5aa10b10389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996aeaa6-4262-4066-9531-e5aa10b10389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f421d915-8df7-405b-bb58-0e606fc6218b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume 4fde24ba-b4d6-4856-9cb4-e4233509327d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fde24ba-b4d6-4856-9cb4-e4233509327d', 'volume_size': 1}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (82c83a98-1af7-4f75-ab82-ce1e97cc0b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc11129b-d9e1-4843-8b5c-5a522e9bec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Acquiring lock "cinder-24d4a77f-88a1-4273-85fd-791cf7e46041-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc11129b-d9e1-4843-8b5c-5a522e9bec90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1516889666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fbc805-d360-409a-a4e3-1b6ea55ffb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:16Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e6e6a5-5630-4dcc-a114-9746a229cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e6e6a5-5630-4dcc-a114-9746a229cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4124635-1a5c-427d-8245-fb3de841b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4124635-1a5c-427d-8245-fb3de841b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7fbc805-d360-409a-a4e3-1b6ea55ffb47', 'volume_name': 'volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f634453a-fd26-4109-97ab-0b2c4e9eea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f634453a-fd26-4109-97ab-0b2c4e9eea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cc5131-7440-4e12-91c2-488023bcfa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume b7fbc805-d360-409a-a4e3-1b6ea55ffb47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47', 'volume_size': 1}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Lock "cinder-24d4a77f-88a1-4273-85fd-791cf7e46041-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Acquiring lock "cinder-quobyte-24d4a77f-88a1-4273-85fd-791cf7e46041" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Lock "cinder-quobyte-24d4a77f-88a1-4273-85fd-791cf7e46041" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ac432e-7a0a-4796-8150-702234a9d3aa]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:15 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90 1073741824" returned: 0 in 0.770s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:15 devstack sudo[88565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90
Apr 20 17:35:15 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:15 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041
Apr 20 17:35:15 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (fc59767f-2390-4ef8-896b-b64e22298788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09d880a-433e-4949-9b9e-5200c77290ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09d880a-433e-4949-9b9e-5200c77290ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-197073916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d937663d-dd09-4029-8819-8901ef0c0b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:16Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68943f74-0a8a-43c4-8337-20b2bb6b35e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68943f74-0a8a-43c4-8337-20b2bb6b35e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67987699-30ac-4418-b8b5-30149173a2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67987699-30ac-4418-b8b5-30149173a2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd937663d-dd09-4029-8819-8901ef0c0b77', 'volume_name': 'volume-d937663d-dd09-4029-8819-8901ef0c0b77', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e209cb1-d5d0-46dd-a598-af894d59759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e209cb1-d5d0-46dd-a598-af894d59759f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6009155c-5ec9-4218-97c3-92fe88782ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:16 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume d937663d-dd09-4029-8819-8901ef0c0b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d937663d-dd09-4029-8819-8901ef0c0b77', 'volume_size': 1}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:16 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90" returned: 0 in 0.484s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.120s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:16 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1608503265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ab6abc-13f7-4b37-87e9-6b509c134856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:15Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Creating volume 54ab6abc-13f7-4b37-87e9-6b509c134856 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:16 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041" returned: 0 in 0.564s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c592cc7b-fb80-4844-9279-49b70b40da6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96066c8e-7846-483c-b52e-cc86e1d4c58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:16 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856 1073741824
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:16 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:16 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90 (b80d1139-8a1b-4beb-9f4c-6516bf288d90): created successfully
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96066c8e-7846-483c-b52e-cc86e1d4c58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:16 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (97343ee6-9b16-4f7c-bb7b-d4cd96bb5f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:16 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:16 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-53082fb5-8f85-4a97-b982-0c35fef37587 tempest-CreateVolumesFromSnapshotTest-816938383 None] Created volume successfully.
Apr 20 17:35:16 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856 1073741824" returned: 0 in 0.561s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:16 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-24d4a77f-88a1-4273-85fd-791cf7e46041" returned: 0 in 0.544s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Lock "cinder-quobyte-24d4a77f-88a1-4273-85fd-791cf7e46041" released by "delete_volume" :: held 1.149s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:16 devstack sudo[88581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856
Apr 20 17:35:16 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:16 devstack cinder-volume[82690]: WARNING cinder.quota [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-758579461 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-758579461, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:35:17 devstack cinder-volume[82690]: WARNING cinder.quota [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-758579461 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-758579461, it is now deprecated. Please use the default quota class for default quota.
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Created reservations ['b2751f8d-3f8f-452d-a0dc-dcef799cd8a5', 'f864b421-0f80-4014-ae85-064d68f50be5', 'd1ceecbe-4a28-4853-a32b-dc22adb18f61', 'b97bddb9-85c9-460e-94c0-5f3f6ee97e9d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:17 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:17 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:17 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856" returned: 0 in 0.449s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687678040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fde24ba-b4d6-4856-9cb4-e4233509327d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:15Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Creating volume 4fde24ba-b4d6-4856-9cb4-e4233509327d {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:17 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b517db8-f86c-4af8-ae3a-6fc2839edde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ab6abc-13f7-4b37-87e9-6b509c134856', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cafe1f6-5f54-420c-8dee-1f8fc6b65629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:17 devstack sudo[88587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d 1073741824
Apr 20 17:35:17 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:17 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume volume-54ab6abc-13f7-4b37-87e9-6b509c134856 (54ab6abc-13f7-4b37-87e9-6b509c134856): created successfully
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cafe1f6-5f54-420c-8dee-1f8fc6b65629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (da3f35db-5650-4928-8307-2a40da0c695a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:17 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-5fff1409-46de-402e-80ef-cb459d6ea569 tempest-CreateVolumesFromSnapshotTest-816938383 None] Created volume successfully.
Apr 20 17:35:17 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.464s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:17 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Deleted volume successfully.
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-464b7479-b797-4e1c-9638-7a46fda33b75 tempest-VolumeTypesAccessTest-836961534 None] Lock "cinder-24d4a77f-88a1-4273-85fd-791cf7e46041-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:17 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d 1073741824" returned: 0 in 0.560s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:18 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d
Apr 20 17:35:18 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:18 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d" returned: 0 in 0.461s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.711s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1516889666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fbc805-d360-409a-a4e3-1b6ea55ffb47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:16Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Creating volume b7fbc805-d360-409a-a4e3-1b6ea55ffb47 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:18 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f421d915-8df7-405b-bb58-0e606fc6218b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fde24ba-b4d6-4856-9cb4-e4233509327d', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:18 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47 1073741824
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a6b0a7-ac64-4bf2-822b-4b5e685c65d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:18 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:18 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume volume-4fde24ba-b4d6-4856-9cb4-e4233509327d (4fde24ba-b4d6-4856-9cb4-e4233509327d): created successfully
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a6b0a7-ac64-4bf2-822b-4b5e685c65d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:18 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (4e69fce5-9d24-44a6-a581-585c85fcf582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:18 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ad93af2a-3033-4da6-8c21-03b1b7406ebf tempest-CreateVolumesFromSnapshotTest-816938383 None] Created volume successfully.
Apr 20 17:35:19 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47 1073741824" returned: 0 in 0.536s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:19 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47
Apr 20 17:35:19 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:19 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47" returned: 0 in 0.453s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-197073916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d937663d-dd09-4029-8819-8901ef0c0b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95315fcb3836464eb99d17e1f149f77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:16Z,use_quota=True,user_id='2549c11fd59a40ceba0608c7f18088d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Creating volume d937663d-dd09-4029-8819-8901ef0c0b77 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:19 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13cc5131-7440-4e12-91c2-488023bcfa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97408fa9-16d2-4b48-9464-06d162269f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:19 devstack sudo[88603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77 1073741824
Apr 20 17:35:19 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:19 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47 (b7fbc805-d360-409a-a4e3-1b6ea55ffb47): created successfully
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97408fa9-16d2-4b48-9464-06d162269f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (82c83a98-1af7-4f75-ab82-ce1e97cc0b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:19 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b555f9a4-d638-4772-aa83-5f8d53f48a2f tempest-CreateVolumesFromSnapshotTest-816938383 None] Created volume successfully.
Apr 20 17:35:20 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77 1073741824" returned: 0 in 0.803s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:20 devstack sudo[88608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77
Apr 20 17:35:20 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:20 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77" returned: 0 in 0.499s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6009155c-5ec9-4218-97c3-92fe88782ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d937663d-dd09-4029-8819-8901ef0c0b77', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd6b91e-e641-4a52-aaae-dd9dea6df001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:20 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Volume volume-d937663d-dd09-4029-8819-8901ef0c0b77 (d937663d-dd09-4029-8819-8901ef0c0b77): created successfully
Apr 20 17:35:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd6b91e-e641-4a52-aaae-dd9dea6df001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Flow 'volume_create_manager' (fc59767f-2390-4ef8-896b-b64e22298788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:20 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c7712eee-f225-479c-96e3-df23e55ca291 tempest-CreateVolumesFromSnapshotTest-816938383 None] Created volume successfully.
Apr 20 17:35:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-d937663d-dd09-4029-8819-8901ef0c0b77-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-d937663d-dd09-4029-8819-8901ef0c0b77-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-quobyte-d937663d-dd09-4029-8819-8901ef0c0b77" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-d937663d-dd09-4029-8819-8901ef0c0b77" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:21 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[884c03ef-3ef1-4e44-bf8e-ca09ee7c458b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:21 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77
Apr 20 17:35:21 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:22 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77" returned: 0 in 0.583s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:22 devstack sudo[88616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77
Apr 20 17:35:22 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:22 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d937663d-dd09-4029-8819-8901ef0c0b77" returned: 0 in 0.503s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-d937663d-dd09-4029-8819-8901ef0c0b77" released by "delete_volume" :: held 1.117s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Created reservations ['33674c95-b4b8-46b2-b1f1-56adbfd1440c', 'af115141-706c-4db1-9dd7-6cb3ddec05f1', 'd8324d50-5ae3-4a2b-8131-16f4d8a50430', '6cfc4b39-6d50-4df2-b7dc-eeefa5015a40'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:22 devstack sudo[88619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:22 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:23 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.448s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:23 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:23 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Deleted volume successfully.
Apr 20 17:35:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-06fe6948-969b-44e3-8bed-8404d78a09c3 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-d937663d-dd09-4029-8819-8901ef0c0b77-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-b7fbc805-d360-409a-a4e3-1b6ea55ffb47-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-b7fbc805-d360-409a-a4e3-1b6ea55ffb47-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-quobyte-b7fbc805-d360-409a-a4e3-1b6ea55ffb47" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-b7fbc805-d360-409a-a4e3-1b6ea55ffb47" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:23 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5336f89-6520-4df8-a260-3ae660f549e7]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:23 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47
Apr 20 17:35:23 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:24 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47" returned: 0 in 0.644s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:24 devstack sudo[88627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47
Apr 20 17:35:24 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (1b65a2a4-972c-4b53-80fc-eb354d51db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47aa666d-fa46-47e5-aa46-35d2fd98b5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47aa666d-fa46-47e5-aa46-35d2fd98b5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1473929513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9023ba-8eb2-467d-91ce-f0c29b51ee76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaab0e2124c4cb9bdce7125faaef21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:25Z,use_quota=True,user_id='33fc371cd55249208a13b46f9971b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb9a8c9-1941-44be-af27-d01f30701cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb9a8c9-1941-44be-af27-d01f30701cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ae7997-a80e-43c8-a0b4-0d2bcd56bb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ae7997-a80e-43c8-a0b4-0d2bcd56bb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9023ba-8eb2-467d-91ce-f0c29b51ee76', 'volume_name': 'volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb96fb2-c8a1-4847-84d5-1cc4b69244fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb96fb2-c8a1-4847-84d5-1cc4b69244fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7449c31a-ac9d-4d68-9262-636d948d24a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:24 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Volume 4c9023ba-8eb2-467d-91ce-f0c29b51ee76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76', 'volume_size': 1}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1473929513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9023ba-8eb2-467d-91ce-f0c29b51ee76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaab0e2124c4cb9bdce7125faaef21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:25Z,use_quota=True,user_id='33fc371cd55249208a13b46f9971b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Creating volume 4c9023ba-8eb2-467d-91ce-f0c29b51ee76 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:24 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:24 devstack sudo[88629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 1073741824
Apr 20 17:35:24 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:24 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b7fbc805-d360-409a-a4e3-1b6ea55ffb47" returned: 0 in 0.510s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-b7fbc805-d360-409a-a4e3-1b6ea55ffb47" released by "delete_volume" :: held 1.179s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Created reservations ['f064e535-c348-4603-adf5-06ba59aa3c6d', '1d3780de-9b81-489c-8dae-98f3aa6d8fc5', 'bcf3196f-0fa3-4882-beb8-aeea4229f0da', '7722881a-8690-441b-b278-9ba3feceb6fe'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:25 devstack sudo[88632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:25 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:25 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 1073741824" returned: 0 in 0.555s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:25 devstack sudo[88638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76
Apr 20 17:35:25 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:25 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.440s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:25 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Deleted volume successfully.
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-55863250-af2b-4b15-b775-2d13da5cff84 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-b7fbc805-d360-409a-a4e3-1b6ea55ffb47-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:25 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" returned: 0 in 0.462s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7449c31a-ac9d-4d68-9262-636d948d24a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0432f97d-31af-4e02-b068-e74c379eecf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-4fde24ba-b4d6-4856-9cb4-e4233509327d-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:25 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Volume volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 (4c9023ba-8eb2-467d-91ce-f0c29b51ee76): created successfully
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0432f97d-31af-4e02-b068-e74c379eecf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (1b65a2a4-972c-4b53-80fc-eb354d51db05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-4fde24ba-b4d6-4856-9cb4-e4233509327d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:25 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-32f4365d-5bf0-4d2a-82fd-29741aa14470 tempest-VolumesSnapshotTestJSON-157764661 None] Created volume successfully.
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-quobyte-4fde24ba-b4d6-4856-9cb4-e4233509327d" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-4fde24ba-b4d6-4856-9cb4-e4233509327d" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac9cc7a-de41-483c-959a-14cafaa7b4ac]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:26 devstack sudo[88641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d
Apr 20 17:35:26 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:26 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d" returned: 0 in 0.489s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:26 devstack sudo[88647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d
Apr 20 17:35:26 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:26 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4fde24ba-b4d6-4856-9cb4-e4233509327d" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:26 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-4fde24ba-b4d6-4856-9cb4-e4233509327d" released by "delete_volume" :: held 1.001s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Created reservations ['7792ffb5-4284-4abb-86ad-ef8ae5abf571', 'f389b602-6750-4180-bcd9-456312ff3ae1', '83f8eff4-670c-4c0b-a244-a33b9b8d2e3c', '2f02ef9d-2140-4d7d-af89-1a23f8683e36'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Creating offline snapshot 0c39151a-ef1a-45d6-8a88-0dec766034fe of volume 4c9023ba-8eb2-467d-91ce-f0c29b51ee76 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[672c04f7-bb08-43a3-b2b0-9d117e32d773]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:27 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:27 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:27 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76
Apr 20 17:35:27 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:27 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.570s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:27 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Deleted volume successfully.
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-25a22496-59b6-4817-991d-cf6ced3780af tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-4fde24ba-b4d6-4856-9cb4-e4233509327d-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:27 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" returned: 0 in 0.637s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:27 devstack sudo[88658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe 1G
Apr 20 17:35:27 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-54ab6abc-13f7-4b37-87e9-6b509c134856-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-54ab6abc-13f7-4b37-87e9-6b509c134856-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-quobyte-54ab6abc-13f7-4b37-87e9-6b509c134856" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-54ab6abc-13f7-4b37-87e9-6b509c134856" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[3303d1d7-4ae0-48c4-86c0-476df6c02f91]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:28 devstack sudo[88663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856
Apr 20 17:35:28 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:28 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe 1G" returned: 0 in 0.597s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:28 devstack sudo[88665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe
Apr 20 17:35:28 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:28 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856" returned: 0 in 0.585s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:28 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856
Apr 20 17:35:28 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:28 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe" returned: 0 in 0.510s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:28 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe is being set with open permissions: ugo+rw
Apr 20 17:35:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:28 devstack sudo[88675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe
Apr 20 17:35:28 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:29 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-54ab6abc-13f7-4b37-87e9-6b509c134856" returned: 0 in 0.512s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-54ab6abc-13f7-4b37-87e9-6b509c134856" released by "delete_volume" :: held 1.118s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:29 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe" returned: 0 in 0.486s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Created reservations ['f2f11c5b-0f51-4850-a8c1-fe4309fae22b', 'f0383780-d73e-49da-98fd-01d42ba69f00', '3295ce90-c81d-4195-b651-60b53f740fb9', 'f0771bd4-a8fc-45a9-83ab-645bc8543240'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:29 devstack sudo[88679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.info
Apr 20 17:35:29 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:29 devstack sudo[88681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:29 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:29 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.info" returned: 0 in 0.443s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:29 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.info is being set with open permissions: ugo+rw
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:29 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.info
Apr 20 17:35:29 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:29 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.517s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:29 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Deleted volume successfully.
Apr 20 17:35:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49127504-9c38-4de2-b0f0-1732ba6c3980 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-54ab6abc-13f7-4b37-87e9-6b509c134856-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:30 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.info" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.213s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:30 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-207e9316-323a-447b-ba85-7b9faf21dff5 tempest-VolumesSnapshotTestJSON-157764661 None] Create snapshot completed successfully
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-b80d1139-8a1b-4beb-9f4c-6516bf288d90-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-b80d1139-8a1b-4beb-9f4c-6516bf288d90-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-quobyte-b80d1139-8a1b-4beb-9f4c-6516bf288d90" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-b80d1139-8a1b-4beb-9f4c-6516bf288d90" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[456e4268-bd6a-4dec-837a-f8dee1d215db]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:30 devstack sudo[88688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90
Apr 20 17:35:30 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:30 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90" returned: 0 in 0.506s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:30 devstack sudo[88693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90
Apr 20 17:35:30 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-0c39151a-ef1a-45d6-8a88-0dec766034fe-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-0c39151a-ef1a-45d6-8a88-0dec766034fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-0c39151a-ef1a-45d6-8a88-0dec766034fe" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-0c39151a-ef1a-45d6-8a88-0dec766034fe" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Deleting offline snapshot 0c39151a-ef1a-45d6-8a88-0dec766034fe of volume 4c9023ba-8eb2-467d-91ce-f0c29b51ee76 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] snapshot_file for this snap is: volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[54407442-8bb0-422c-a36c-852902dbd199]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:31 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b80d1139-8a1b-4beb-9f4c-6516bf288d90" returned: 0 in 0.518s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-b80d1139-8a1b-4beb-9f4c-6516bf288d90" released by "delete_volume" :: held 1.052s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Created reservations ['6e53959d-e542-494e-ac35-3a78c256561e', '060274b6-4049-4c9c-ad45-2bef9d2a5e00', '31167162-8a43-4f34-bd6f-abb125f51444', '966c9c62-d1c4-4077-962e-873a035ac102'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:31 devstack sudo[88696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe
Apr 20 17:35:31 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:31 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:31 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:31 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.481s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:31 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Deleted volume successfully.
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-609829e5-f379-453d-9549-458eaf211229 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-b80d1139-8a1b-4beb-9f4c-6516bf288d90-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:31 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe" returned: 0 in 0.652s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1223857b-b46f-4cdf-a89c-d68a8283b99a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:32 devstack sudo[88704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76
Apr 20 17:35:32 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-quobyte-959d4f79-4590-4f84-b4b8-c84338ce0121" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-959d4f79-4590-4f84-b4b8-c84338ce0121" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-quobyte-5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Deleting offline snapshot 5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c of volume 959d4f79-4590-4f84-b4b8-c84338ce0121 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] snapshot_file for this snap is: volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[53418afd-0a69-4c49-8750-5f957b8d98f1]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:32 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" returned: 0 in 0.583s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:32 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe
Apr 20 17:35:32 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:32 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c
Apr 20 17:35:32 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:33 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c" returned: 0 in 0.534s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-959d4f79-4590-4f84-b4b8-c84338ce0121(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca57955-5cea-4050-b9e0-cc16a28adc32]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:33 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe" returned: 0 in 0.534s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:33 devstack sudo[88720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe
Apr 20 17:35:33 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:33 devstack sudo[88719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121
Apr 20 17:35:33 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:33 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121" returned: 0 in 0.545s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:33 devstack sudo[88727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c
Apr 20 17:35:33 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:33 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76.0c39151a-ef1a-45d6-8a88-0dec766034fe" returned: 0 in 0.554s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-0c39151a-ef1a-45d6-8a88-0dec766034fe" released by "_delete_snapshot" :: held 2.391s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" released by "delete_snapshot" :: held 2.404s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Created reservations ['77932b07-c209-4331-bea1-e348378d64a5', '6f89a010-5975-4f58-a04b-056db3264edd', '3abd37d7-5a90-47f0-a60f-de42fa9b7daa', '45106417-9665-49f5-9425-be7aa41e4f51'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:33 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Delete snapshot completed successfully.
Apr 20 17:35:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a1176570-fa9b-4177-a69d-4a07d0ebe8e5 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-0c39151a-ef1a-45d6-8a88-0dec766034fe-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:34 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c" returned: 0 in 0.460s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:34 devstack sudo[88732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c
Apr 20 17:35:34 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:34 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121.5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c" returned: 0 in 0.424s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c" released by "_delete_snapshot" :: held 2.023s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-959d4f79-4590-4f84-b4b8-c84338ce0121" released by "delete_snapshot" :: held 2.039s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:34 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Created reservations ['644d2741-89d5-44d5-8e11-1d6cd5a5fb7e', '0671de91-57f5-4a91-a653-4f2d340b34c8', '6f781aa1-77e8-47b2-bbae-926d7067b548', '316c77fc-e29d-40f1-a205-14eee21fb579'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:34 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Delete snapshot completed successfully.
Apr 20 17:35:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-482982ff-8824-42c3-a473-df961bce357a tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-5dc830f6-8f4a-4406-a2e6-48dfd24d7b3c-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (52eb4105-54a2-427e-8a57-a0a54c418226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3eacb0-81e7-4968-9cec-9dd8daf81779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3eacb0-81e7-4968-9cec-9dd8daf81779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-201469381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a7ef67-588e-46f3-a05e-c5ab7d175e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaab0e2124c4cb9bdce7125faaef21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:35Z,use_quota=True,user_id='33fc371cd55249208a13b46f9971b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656939a6-d53a-44c7-8dc6-8903533afda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656939a6-d53a-44c7-8dc6-8903533afda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cf549e-2911-4a2f-b393-b5e0e0a86b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cf549e-2911-4a2f-b393-b5e0e0a86b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a7ef67-588e-46f3-a05e-c5ab7d175e19', 'volume_name': 'volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16df7da-49f0-408a-897e-0d7c2521ff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16df7da-49f0-408a-897e-0d7c2521ff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6ffb01-08da-4b16-86e4-d2200955661e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:35 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Volume b6a7ef67-588e-46f3-a05e-c5ab7d175e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19', 'volume_size': 1}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-201469381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a7ef67-588e-46f3-a05e-c5ab7d175e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaab0e2124c4cb9bdce7125faaef21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:35Z,use_quota=True,user_id='33fc371cd55249208a13b46f9971b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Creating volume b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:35 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:35 devstack sudo[88735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 1073741824
Apr 20 17:35:35 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:35 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 1073741824" returned: 0 in 0.496s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:35 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19
Apr 20 17:35:35 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-959d4f79-4590-4f84-b4b8-c84338ce0121-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-959d4f79-4590-4f84-b4b8-c84338ce0121-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "cinder-quobyte-959d4f79-4590-4f84-b4b8-c84338ce0121" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-959d4f79-4590-4f84-b4b8-c84338ce0121" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6367798e-a7f5-41e9-ad5b-9e76f199df6f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:35 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121
Apr 20 17:35:35 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:36 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" returned: 0 in 0.478s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6ffb01-08da-4b16-86e4-d2200955661e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1183dd-e85d-4ba3-a02a-7acb22dcdc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:36 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Volume volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 (b6a7ef67-588e-46f3-a05e-c5ab7d175e19): created successfully
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1183dd-e85d-4ba3-a02a-7acb22dcdc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (52eb4105-54a2-427e-8a57-a0a54c418226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:36 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0ba716db-e1ac-4e7e-9a40-d54fc823eba1 tempest-VolumesSnapshotTestJSON-157764661 None] Created volume successfully.
Apr 20 17:35:36 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121" returned: 0 in 0.535s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:36 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121
Apr 20 17:35:36 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:36 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-959d4f79-4590-4f84-b4b8-c84338ce0121" returned: 0 in 0.456s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-quobyte-959d4f79-4590-4f84-b4b8-c84338ce0121" released by "delete_volume" :: held 1.036s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Created reservations ['55009af6-c898-4302-9d97-3137cdaf062a', 'caf1c2c5-3bb2-4511-9a90-be8403dd2917', '432813fe-4f14-4e22-86f5-3cdbf86fcf57', '4d376abc-f8a7-4d68-acc5-8ae20ff77783'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:36 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:36 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Creating offline snapshot cbf91ee7-0603-4b8f-99ec-e0c233924967 of volume b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7635cd-71b0-4ed7-b06f-c95ac57861a9]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:37 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19
Apr 20 17:35:37 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:37 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.491s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Deleted volume successfully.
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9f4ccc01-4b1b-49dd-b3bd-003b5fb3d689 tempest-CreateVolumesFromSnapshotTest-816938383 None] Lock "cinder-959d4f79-4590-4f84-b4b8-c84338ce0121-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:37 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" returned: 0 in 0.520s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:37 devstack sudo[88760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 1G
Apr 20 17:35:37 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:38 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 1G" returned: 0 in 0.610s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:38 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967
Apr 20 17:35:38 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:38 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967" returned: 0 in 0.556s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:38 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 is being set with open permissions: ugo+rw
Apr 20 17:35:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:38 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967
Apr 20 17:35:38 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:39 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967" returned: 0 in 0.494s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:39 devstack sudo[88773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.info
Apr 20 17:35:39 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Flow 'volume_create_manager' (a1b1c01b-176b-4d57-90ea-c01f5bd4aa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbef1ae-acba-4499-878d-f46f64871c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbef1ae-acba-4499-878d-f46f64871c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb543f3-7894-450c-87b0-32c4ebea1b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7001c8e1588746e2a5606786a458663c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:40Z,use_quota=True,user_id='710ab72c79194fdc9460a7623a5b2cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6244bc-2980-4f2a-b71a-620bca753ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6244bc-2980-4f2a-b71a-620bca753ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27211824-7386-4850-b818-d0ea17550161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27211824-7386-4850-b818-d0ea17550161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb543f3-7894-450c-87b0-32c4ebea1b98', 'volume_name': 'volume-feb543f3-7894-450c-87b0-32c4ebea1b98', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8656a5c-5c4a-468e-bab7-33d22af4be2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8656a5c-5c4a-468e-bab7-33d22af4be2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3536f3-3bc1-40da-a48e-827da48c3531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:39 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Volume feb543f3-7894-450c-87b0-32c4ebea1b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb543f3-7894-450c-87b0-32c4ebea1b98', 'volume_size': 1}
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:39 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.info" returned: 0 in 0.522s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:39 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.info is being set with open permissions: ugo+rw
Apr 20 17:35:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:40 devstack sudo[88776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.info
Apr 20 17:35:40 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:40 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.info" returned: 0 in 0.424s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.185s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb543f3-7894-450c-87b0-32c4ebea1b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7001c8e1588746e2a5606786a458663c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:40Z,use_quota=True,user_id='710ab72c79194fdc9460a7623a5b2cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Creating volume feb543f3-7894-450c-87b0-32c4ebea1b98 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:40 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:40 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-195dd623-5ba9-4dab-8fea-5fca83127038 tempest-VolumesSnapshotTestJSON-157764661 None] Create snapshot completed successfully
Apr 20 17:35:40 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98 1073741824
Apr 20 17:35:40 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:40 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98 1073741824" returned: 0 in 0.527s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:41 devstack sudo[88784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98
Apr 20 17:35:41 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:41 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98" returned: 0 in 0.450s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3536f3-3bc1-40da-a48e-827da48c3531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb543f3-7894-450c-87b0-32c4ebea1b98', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3493e1d4-9746-4c59-ab3f-cdff47c7cbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:41 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Volume volume-feb543f3-7894-450c-87b0-32c4ebea1b98 (feb543f3-7894-450c-87b0-32c4ebea1b98): created successfully
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3493e1d4-9746-4c59-ab3f-cdff47c7cbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Flow 'volume_create_manager' (a1b1c01b-176b-4d57-90ea-c01f5bd4aa89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:41 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7944218d-f8f9-4cbd-b3a5-c70a74194a80 tempest-CinderUnicodeTest-401627398 None] Created volume successfully.
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (4d5e634c-701a-4a50-9c4e-de2568cd8d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5b0195-5169-44a8-8d63-437948fa04d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5b0195-5169-44a8-8d63-437948fa04d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1497247188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66688209-d9f3-47e4-a6fb-a69a03d423f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaab0e2124c4cb9bdce7125faaef21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=cbf91ee7-0603-4b8f-99ec-e0c233924967,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:42Z,use_quota=True,user_id='33fc371cd55249208a13b46f9971b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cdf790-2090-4431-b6aa-95d1ccd2c63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cdf790-2090-4431-b6aa-95d1ccd2c63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e75020-3bb8-4ee0-8c37-6bd38564ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e75020-3bb8-4ee0-8c37-6bd38564ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66688209-d9f3-47e4-a6fb-a69a03d423f2', 'volume_name': 'volume-66688209-d9f3-47e4-a6fb-a69a03d423f2', 'volume_size': 2, 'snapshot_id': 'cbf91ee7-0603-4b8f-99ec-e0c233924967'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462d2760-68a7-4c9b-aee6-3f459c83ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462d2760-68a7-4c9b-aee6-3f459c83ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0c7111-938b-48ac-ab02-79e70bf60563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:41 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Volume 66688209-d9f3-47e4-a6fb-a69a03d423f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66688209-d9f3-47e4-a6fb-a69a03d423f2', 'volume_size': 2, 'snapshot_id': 'cbf91ee7-0603-4b8f-99ec-e0c233924967'}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-cbf91ee7-0603-4b8f-99ec-e0c233924967-66688209-d9f3-47e4-a6fb-a69a03d423f2" by "_create_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-cbf91ee7-0603-4b8f-99ec-e0c233924967-66688209-d9f3-47e4-a6fb-a69a03d423f2" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Creating volume 66688209-d9f3-47e4-a6fb-a69a03d423f2 from snapshot cbf91ee7-0603-4b8f-99ec-e0c233924967 {{(pid=82690) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-66688209-d9f3-47e4-a6fb-a69a03d423f2" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-66688209-d9f3-47e4-a6fb-a69a03d423f2" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] snapshot: cbf91ee7-0603-4b8f-99ec-e0c233924967, volume: 66688209-d9f3-47e4-a6fb-a69a03d423f2,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[645e8f4c-fefd-4d90-af1e-04fe4c98b3ba]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:41 devstack sudo[88787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967
Apr 20 17:35:41 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:42 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967" returned: 0 in 0.500s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1672c565-1054-4ace-b16c-82d08ec2fb08]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:42 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19
Apr 20 17:35:42 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Flow 'volume_create_manager' (cf4b3419-7066-449d-8deb-c1e242b1d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3a66ef-2286-4376-b3bc-ac8a546f1184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3a66ef-2286-4376-b3bc-ac8a546f1184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-991429506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ea1133-01c5-4ddf-8600-a116cb2221c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7001c8e1588746e2a5606786a458663c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:42Z,use_quota=True,user_id='710ab72c79194fdc9460a7623a5b2cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6dbb75-0207-43a6-8eb5-f8d65e79adf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6dbb75-0207-43a6-8eb5-f8d65e79adf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99519852-6816-4299-9151-f333c0773d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99519852-6816-4299-9151-f333c0773d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ea1133-01c5-4ddf-8600-a116cb2221c6', 'volume_name': 'volume-51ea1133-01c5-4ddf-8600-a116cb2221c6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5fa6f0-5adb-47c5-8274-08eef7d1082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5fa6f0-5adb-47c5-8274-08eef7d1082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec0c219-16c7-4183-a454-684d4fb28da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:42 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Volume 51ea1133-01c5-4ddf-8600-a116cb2221c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ea1133-01c5-4ddf-8600-a116cb2221c6', 'volume_size': 1}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:42 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" returned: 0 in 0.545s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2 not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:35:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:42 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2
Apr 20 17:35:42 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:35:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:43 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:43 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:44 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 1.436s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:44 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:45 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2" returned: 0 in 2.443s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:45 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9209e3-c533-40f9-ba30-7222494f51bf]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:45 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19
Apr 20 17:35:45 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:45 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" returned: 0 in 0.640s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:45 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:35:45 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Converted 1024.00 MB image at 419.02 MB/s
Apr 20 17:35:45 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2 is being set with open permissions: ugo+rw
Apr 20 17:35:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:45 devstack sudo[88825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2
Apr 20 17:35:45 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:46 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2" returned: 0 in 0.450s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-66688209-d9f3-47e4-a6fb-a69a03d423f2" released by "_copy_volume_from_snapshot" :: held 4.636s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-cbf91ee7-0603-4b8f-99ec-e0c233924967-66688209-d9f3-47e4-a6fb-a69a03d423f2" released by "_create_volume_from_snapshot" :: held 4.650s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.660s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.941s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-991429506',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ea1133-01c5-4ddf-8600-a116cb2221c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7001c8e1588746e2a5606786a458663c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:42Z,use_quota=True,user_id='710ab72c79194fdc9460a7623a5b2cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Creating volume 51ea1133-01c5-4ddf-8600-a116cb2221c6 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:46 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:46 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 1073741824
Apr 20 17:35:46 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0c7111-938b-48ac-ab02-79e70bf60563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66688209-d9f3-47e4-a6fb-a69a03d423f2', 'volume_size': 2, 'snapshot_id': 'cbf91ee7-0603-4b8f-99ec-e0c233924967'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e381524-6e63-4831-acf0-cf5fff4fce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:46 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Volume volume-66688209-d9f3-47e4-a6fb-a69a03d423f2 (66688209-d9f3-47e4-a6fb-a69a03d423f2): created successfully
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e381524-6e63-4831-acf0-cf5fff4fce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (4d5e634c-701a-4a50-9c4e-de2568cd8d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:46 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-98ca4966-22c1-40f3-b501-67872a8e5d0c tempest-VolumesSnapshotTestJSON-157764661 None] Created volume successfully.
Apr 20 17:35:46 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 1073741824" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:46 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6
Apr 20 17:35:46 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-66688209-d9f3-47e4-a6fb-a69a03d423f2-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-66688209-d9f3-47e4-a6fb-a69a03d423f2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-66688209-d9f3-47e4-a6fb-a69a03d423f2" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-66688209-d9f3-47e4-a6fb-a69a03d423f2" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf650ff-c222-4d4b-b659-ab203d88ff5f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:47 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2
Apr 20 17:35:47 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:47 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6" returned: 0 in 0.429s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ec0c219-16c7-4183-a454-684d4fb28da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ea1133-01c5-4ddf-8600-a116cb2221c6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc2271a-1b02-4957-b685-d3e1c24dab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:47 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Volume volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 (51ea1133-01c5-4ddf-8600-a116cb2221c6): created successfully
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fc2271a-1b02-4957-b685-d3e1c24dab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Flow 'volume_create_manager' (cf4b3419-7066-449d-8deb-c1e242b1d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:47 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-1459d521-a55f-42b0-ac68-4e0727d5ec77 tempest-CinderUnicodeTest-401627398 None] Created volume successfully.
Apr 20 17:35:47 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2" returned: 0 in 0.480s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:47 devstack sudo[88843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2
Apr 20 17:35:47 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Creating offline snapshot 2aa4809b-2348-40fd-9577-6423e755f75e of volume 51ea1133-01c5-4ddf-8600-a116cb2221c6 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2180bd-473a-4ee6-a3b1-aa60659629d2]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:48 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6
Apr 20 17:35:48 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:48 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-66688209-d9f3-47e4-a6fb-a69a03d423f2" returned: 0 in 0.453s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-66688209-d9f3-47e4-a6fb-a69a03d423f2" released by "delete_volume" :: held 0.956s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Created reservations ['64b42a1e-74bc-4023-934e-56ae35d1ec05', 'f3faaf0b-f323-424f-939b-41fb992ead2e', '2253e317-2ef8-4271-a137-59dbc7f4aadb', 'd8fc4943-0a82-4ea9-846f-57b76c7ec011'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:48 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:48 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-cbf91ee7-0603-4b8f-99ec-e0c233924967-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-cbf91ee7-0603-4b8f-99ec-e0c233924967-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-cbf91ee7-0603-4b8f-99ec-e0c233924967" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-cbf91ee7-0603-4b8f-99ec-e0c233924967" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Deleting offline snapshot cbf91ee7-0603-4b8f-99ec-e0c233924967 of volume b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] snapshot_file for this snap is: volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2393cf-245b-4d0a-9d36-161bd499cd88]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:48 devstack sudo[88850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967
Apr 20 17:35:48 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:48 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6" returned: 0 in 0.498s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:48 devstack sudo[88855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e 1G
Apr 20 17:35:48 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:48 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.439s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:48 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Deleted volume successfully.
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-9fa1cab8-13dc-4b69-9bf5-edb2d9b2dfae tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-66688209-d9f3-47e4-a6fb-a69a03d423f2-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:48 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967" returned: 0 in 0.529s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5234e2ce-d2e7-4117-876a-048ca575faef]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:49 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e 1G" returned: 0 in 0.460s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:49 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e
Apr 20 17:35:49 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:49 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19
Apr 20 17:35:49 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:49 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e" returned: 0 in 0.434s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:49 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e is being set with open permissions: ugo+rw
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:49 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" returned: 0 in 0.489s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:49 devstack sudo[88874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e
Apr 20 17:35:49 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:49 devstack sudo[88876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967
Apr 20 17:35:49 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:49 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e" returned: 0 in 0.428s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:49 devstack sudo[88882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.info
Apr 20 17:35:49 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:49 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967" returned: 0 in 0.474s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:49 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967
Apr 20 17:35:49 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:50 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.info" returned: 0 in 0.474s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:50 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.info is being set with open permissions: ugo+rw
Apr 20 17:35:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:50 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19.cbf91ee7-0603-4b8f-99ec-e0c233924967" returned: 0 in 0.441s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:50 devstack sudo[88888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.info
Apr 20 17:35:50 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:50 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-cbf91ee7-0603-4b8f-99ec-e0c233924967" released by "_delete_snapshot" :: held 1.996s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:50 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" released by "delete_snapshot" :: held 2.014s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:50 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Created reservations ['a6108c19-6537-4ebc-8a84-9bfd510eb68f', 'da3f6b84-d8b4-4971-9f31-3e116b8fbcb1', '66c53527-8d5d-46fe-8308-2329b20898e3', '13ca562a-db6e-4405-a0d3-09bccd3414a7'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:50 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Delete snapshot completed successfully.
Apr 20 17:35:50 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a0d9a7ac-5cf0-4de3-bdf7-006684c6fb6b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-cbf91ee7-0603-4b8f-99ec-e0c233924967-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:50 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.info" returned: 0 in 0.530s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:50 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7b11807d-0c64-486d-9ffe-3f6e165d32a9 tempest-CinderUnicodeTest-401627398 None] Create snapshot completed successfully
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "cinder-2aa4809b-2348-40fd-9577-6423e755f75e-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-2aa4809b-2348-40fd-9577-6423e755f75e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "cinder-quobyte-51ea1133-01c5-4ddf-8600-a116cb2221c6" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-quobyte-51ea1133-01c5-4ddf-8600-a116cb2221c6" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "cinder-quobyte-2aa4809b-2348-40fd-9577-6423e755f75e" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-quobyte-2aa4809b-2348-40fd-9577-6423e755f75e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Deleting offline snapshot 2aa4809b-2348-40fd-9577-6423e755f75e of volume 51ea1133-01c5-4ddf-8600-a116cb2221c6 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] snapshot_file for this snap is: volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe2dead-3e34-45f8-89d7-41680acddc46]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:51 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e
Apr 20 17:35:51 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-b6a7ef67-588e-46f3-a05e-c5ab7d175e19-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-b6a7ef67-588e-46f3-a05e-c5ab7d175e19-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef78b5d1-2387-43c4-b98f-1020b1d3cee8]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:51 devstack sudo[88893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19
Apr 20 17:35:51 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:51 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e" returned: 0 in 0.609s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51ea1133-01c5-4ddf-8600-a116cb2221c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60cc47b-a6ff-4ba1-a92e-9863384cba46]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:51 devstack sudo[88899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6
Apr 20 17:35:51 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:52 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" returned: 0 in 0.504s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:52 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19
Apr 20 17:35:52 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:52 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6" returned: 0 in 0.486s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:52 devstack sudo[88921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e
Apr 20 17:35:52 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:52 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" returned: 0 in 0.465s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-b6a7ef67-588e-46f3-a05e-c5ab7d175e19" released by "delete_volume" :: held 1.001s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=143,cinder:UPDATE=204,cinder:INSERT=38,cinder:DELETE=19 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Created reservations ['42a67c83-4104-40c7-8671-cf3c6a98f50e', 'b02cbf8c-047e-44b9-9c51-20eb4e538a32', '76cb8865-a03d-496e-b335-411c36438699', 'dc025432-811c-4838-93c1-45a60cb8cea5'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:52 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:52 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:52 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e" returned: 0 in 0.544s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:52 devstack sudo[88932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e
Apr 20 17:35:52 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:53 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.437s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:53 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:53 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Deleted volume successfully.
Apr 20 17:35:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e737d723-567f-4f45-8e5e-a4e39177b256 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-b6a7ef67-588e-46f3-a05e-c5ab7d175e19-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:53 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6.2aa4809b-2348-40fd-9577-6423e755f75e" returned: 0 in 0.420s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-quobyte-2aa4809b-2348-40fd-9577-6423e755f75e" released by "_delete_snapshot" :: held 2.111s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-quobyte-51ea1133-01c5-4ddf-8600-a116cb2221c6" released by "delete_snapshot" :: held 2.122s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:53 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Created reservations ['baa92e69-53c8-4281-b756-dfd43ad4db6f', 'c413a78b-171c-4dd8-9edd-001a0426d390', '7a7012bc-fc6a-41d3-8e13-5363d4c079e3', '67b89e8e-ffde-4caf-aea8-1ec998b391ec'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:53 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Delete snapshot completed successfully.
Apr 20 17:35:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-34354a56-e140-47ca-979f-bc1615d11867 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-2aa4809b-2348-40fd-9577-6423e755f75e-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=161,cinder:INSERT=64,cinder:UPDATE=200,cinder:DELETE=16 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (72a4dd64-e15b-4025-ad5f-6aaf02fca051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc65884a-2932-43d0-8b91-233faa80ed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc65884a-2932-43d0-8b91-233faa80ed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1783122059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256b2a15-73b9-43bb-ad87-e934fe017f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaab0e2124c4cb9bdce7125faaef21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:54Z,use_quota=True,user_id='33fc371cd55249208a13b46f9971b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7ea42d-4116-40d4-8098-cfcdc8c3c640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7ea42d-4116-40d4-8098-cfcdc8c3c640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e056fd-dbff-4c47-b821-60b7411d925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e056fd-dbff-4c47-b821-60b7411d925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256b2a15-73b9-43bb-ad87-e934fe017f33', 'volume_name': 'volume-256b2a15-73b9-43bb-ad87-e934fe017f33', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96138a62-4783-4092-a27d-4e604b316182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96138a62-4783-4092-a27d-4e604b316182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f81c478-c2e0-44ef-b190-f7ae884c71c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:54 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Volume 256b2a15-73b9-43bb-ad87-e934fe017f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256b2a15-73b9-43bb-ad87-e934fe017f33', 'volume_size': 1}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1783122059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256b2a15-73b9-43bb-ad87-e934fe017f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaab0e2124c4cb9bdce7125faaef21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:54Z,use_quota=True,user_id='33fc371cd55249208a13b46f9971b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Creating volume 256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:54 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:54 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 1073741824
Apr 20 17:35:54 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Acquiring lock "cinder-51ea1133-01c5-4ddf-8600-a116cb2221c6-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Lock "cinder-51ea1133-01c5-4ddf-8600-a116cb2221c6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Acquiring lock "cinder-quobyte-51ea1133-01c5-4ddf-8600-a116cb2221c6" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Lock "cinder-quobyte-51ea1133-01c5-4ddf-8600-a116cb2221c6" acquired by "delete_volume" :: waited 0.019s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001f962-30f4-4927-af05-534121c09295]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:54 devstack sudo[88938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6
Apr 20 17:35:54 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:54 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 1073741824" returned: 0 in 0.494s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:54 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33
Apr 20 17:35:54 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:54 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6" returned: 0 in 0.475s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:54 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6
Apr 20 17:35:54 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:55 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33" returned: 0 in 0.466s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f81c478-c2e0-44ef-b190-f7ae884c71c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256b2a15-73b9-43bb-ad87-e934fe017f33', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfb3ac9-f6cc-4dd3-b0eb-7ad23486a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:55 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Volume volume-256b2a15-73b9-43bb-ad87-e934fe017f33 (256b2a15-73b9-43bb-ad87-e934fe017f33): created successfully
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfb3ac9-f6cc-4dd3-b0eb-7ad23486a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (72a4dd64-e15b-4025-ad5f-6aaf02fca051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ae0a989f-6dfc-4921-822f-06a132ba2057 tempest-VolumesSnapshotTestJSON-157764661 None] Created volume successfully.
Apr 20 17:35:55 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-51ea1133-01c5-4ddf-8600-a116cb2221c6" returned: 0 in 0.436s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Lock "cinder-quobyte-51ea1133-01c5-4ddf-8600-a116cb2221c6" released by "delete_volume" :: held 0.944s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Created reservations ['af6ea20c-3eb0-4316-b82a-c7f64e905f84', 'dc3ecaaa-dd97-4f71-a908-a613f13059a8', 'a9ec9137-64c5-4d6e-9363-b7ea2bca0639', 'c4314453-6446-4813-9a7b-84332dfe673f'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:55 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:55 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "cinder-feb543f3-7894-450c-87b0-32c4ebea1b98-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-feb543f3-7894-450c-87b0-32c4ebea1b98-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "cinder-quobyte-feb543f3-7894-450c-87b0-32c4ebea1b98" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-quobyte-feb543f3-7894-450c-87b0-32c4ebea1b98" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9dacf0-6dd6-44f5-88d9-a4f3c4b345a9]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:55 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98
Apr 20 17:35:55 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:55 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.446s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Deleted volume successfully.
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a77ea4c0-b050-4efb-a1d5-0300c838415c tempest-CinderUnicodeTest-401627398 None] Lock "cinder-51ea1133-01c5-4ddf-8600-a116cb2221c6-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:55 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98" returned: 0 in 0.484s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:56 devstack sudo[88969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98
Apr 20 17:35:56 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Creating offline snapshot 75f961e8-9759-4d2a-99d5-3931e932db17 of volume 256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[94811367-8273-4110-843c-beed3c6066b3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:56 devstack sudo[88972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33
Apr 20 17:35:56 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:56 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-feb543f3-7894-450c-87b0-32c4ebea1b98" returned: 0 in 0.462s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-quobyte-feb543f3-7894-450c-87b0-32c4ebea1b98" released by "delete_volume" :: held 0.966s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Created reservations ['1cbfa1e5-8c1c-4e49-98ff-b9ce2006a0a5', 'c03ba131-425d-4e72-96b1-9658a3baae86', '42850d8b-262a-4a8e-8310-84520e5b75b8', '4ad735b2-e444-4b49-ac87-b22312fef6af'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:56 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:35:56 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:56 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33" returned: 0 in 0.653s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:56 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 1G
Apr 20 17:35:56 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:57 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.726s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:57 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:35:57 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Deleted volume successfully.
Apr 20 17:35:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-553ac329-3447-4b49-aa3e-b7b6ac150af1 tempest-CinderUnicodeTest-401627398 None] Lock "cinder-feb543f3-7894-450c-87b0-32c4ebea1b98-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:35:57 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 1G" returned: 0 in 0.721s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256b2a15-73b9-43bb-ad87-e934fe017f33 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:57 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256b2a15-73b9-43bb-ad87-e934fe017f33 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17
Apr 20 17:35:57 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:58 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-256b2a15-73b9-43bb-ad87-e934fe017f33 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17" returned: 0 in 0.570s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:58 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 is being set with open permissions: ugo+rw
Apr 20 17:35:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:58 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17
Apr 20 17:35:58 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:58 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17" returned: 0 in 0.434s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:58 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.info
Apr 20 17:35:58 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (1706834e-59f0-482f-9275-2c58dade8c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7f412a-8fb3-4708-9dcd-1ffa22901dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7f412a-8fb3-4708-9dcd-1ffa22901dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433599118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:59Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29f0168-f6e1-4505-8646-6db22789b232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29f0168-f6e1-4505-8646-6db22789b232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d565af4-d2e6-4ea3-8af1-597c2814771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d565af4-d2e6-4ea3-8af1-597c2814771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e', 'volume_name': 'volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec2ce98-823e-4e43-8fe1-2ca74c6c896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec2ce98-823e-4e43-8fe1-2ca74c6c896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e569cb-bddc-4801-90bf-b1b3286438cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:35:59 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Volume 4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e', 'volume_size': 1}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:59 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.info" returned: 0 in 0.479s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:59 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.info is being set with open permissions: ugo+rw
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:59 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.info
Apr 20 17:35:59 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:35:59 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.info" returned: 0 in 0.446s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.357s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433599118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:35:59Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Creating volume 4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:35:59 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:35:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:35:59 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-785a719e-1e38-434b-8e19-bebc819fbc46 tempest-VolumesSnapshotTestJSON-157764661 None] Create snapshot completed successfully
Apr 20 17:35:59 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e 1073741824
Apr 20 17:35:59 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:00 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e 1073741824" returned: 0 in 0.503s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:00 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e
Apr 20 17:36:00 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:00 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e" returned: 0 in 0.464s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e569cb-bddc-4801-90bf-b1b3286438cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838a9a78-d784-4376-af38-6c68a7d6c817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:00 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Volume volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e (4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e): created successfully
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838a9a78-d784-4376-af38-6c68a7d6c817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (1706834e-59f0-482f-9275-2c58dade8c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:00 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b9d14638-07e7-4dfc-931c-30f1ab2c24da tempest-VolumesActionsTest-2121574506 None] Created volume successfully.
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (22405b80-2e0a-4872-87f5-12564df95306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf89d4b-44fd-4053-ad90-b90a2ba0df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf89d4b-44fd-4053-ad90-b90a2ba0df63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2023482564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0453d7-85dc-4dfe-ac81-9bbfc7c50662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baaab0e2124c4cb9bdce7125faaef21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75f961e8-9759-4d2a-99d5-3931e932db17,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:01Z,use_quota=True,user_id='33fc371cd55249208a13b46f9971b200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ceea8d-79cf-4e71-aeff-4f25ebc0d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ceea8d-79cf-4e71-aeff-4f25ebc0d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059acd9f-4205-4058-9a98-9763b9f05e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059acd9f-4205-4058-9a98-9763b9f05e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c0453d7-85dc-4dfe-ac81-9bbfc7c50662', 'volume_name': 'volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662', 'volume_size': 1, 'snapshot_id': '75f961e8-9759-4d2a-99d5-3931e932db17'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff77ab7-6355-4172-87df-462868fb6259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff77ab7-6355-4172-87df-462868fb6259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991049e6-c191-4be4-8601-d755b76e09a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:00 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Volume 4c0453d7-85dc-4dfe-ac81-9bbfc7c50662: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662', 'volume_size': 1, 'snapshot_id': '75f961e8-9759-4d2a-99d5-3931e932db17'}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-75f961e8-9759-4d2a-99d5-3931e932db17-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" by "_create_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-75f961e8-9759-4d2a-99d5-3931e932db17-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Creating volume 4c0453d7-85dc-4dfe-ac81-9bbfc7c50662 from snapshot 75f961e8-9759-4d2a-99d5-3931e932db17 {{(pid=82690) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] snapshot: 75f961e8-9759-4d2a-99d5-3931e932db17, volume: 4c0453d7-85dc-4dfe-ac81-9bbfc7c50662,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cff716-3a61-4d47-aebc-cfadab4c4bb7]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:00 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17
Apr 20 17:36:00 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6c57e71c-e465-4e76-bd31-361645e13441 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e" by "attach_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6c57e71c-e465-4e76-bd31-361645e13441 tempest-VolumesActionsTest-2121574506 None] Lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e" acquired by "attach_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:01 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6c57e71c-e465-4e76-bd31-361645e13441 tempest-VolumesActionsTest-2121574506 None] Attaching volume 4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e to instance 06da21a0-976d-4bd2-a8d3-194a656f85f0 at mountpoint /dev/vdb on host None.
Apr 20 17:36:01 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6c57e71c-e465-4e76-bd31-361645e13441 tempest-VolumesActionsTest-2121574506 None] Attach volume completed successfully.
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6c57e71c-e465-4e76-bd31-361645e13441 tempest-VolumesActionsTest-2121574506 None] Lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e" released by "attach_volume" :: held 0.114s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:01 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17" returned: 0 in 0.470s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-256b2a15-73b9-43bb-ad87-e934fe017f33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[9919e1ae-7c24-4248-8ac7-d81b83f11e08]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:01 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33
Apr 20 17:36:01 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:01 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662 not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:36:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:01 devstack sudo[89053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662
Apr 20 17:36:01 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:02 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4101c00b-1fef-4682-b402-2c4d67fef1a3 tempest-VolumesActionsTest-1986317312 None] Terminate volume connection completed successfully.
Apr 20 17:36:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4101c00b-1fef-4682-b402-2c4d67fef1a3 tempest-VolumesActionsTest-1986317312 None] Acquiring lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e-detach_volume" by "detach_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4101c00b-1fef-4682-b402-2c4d67fef1a3 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:02 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4101c00b-1fef-4682-b402-2c4d67fef1a3 tempest-VolumesActionsTest-1986317312 None] Detaching volume 4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e from instance 06da21a0-976d-4bd2-a8d3-194a656f85f0.
Apr 20 17:36:02 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4101c00b-1fef-4682-b402-2c4d67fef1a3 tempest-VolumesActionsTest-1986317312 None] Detach volume completed successfully.
Apr 20 17:36:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4101c00b-1fef-4682-b402-2c4d67fef1a3 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e-detach_volume" released by "detach_volume" :: held 0.281s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-de10fdf3-8a49-4a56-b0bf-dc78b5399ed3 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e-detach_volume" by "detach_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-de10fdf3-8a49-4a56-b0bf-dc78b5399ed3 tempest-VolumesActionsTest-2121574506 None] Lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:03 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-de10fdf3-8a49-4a56-b0bf-dc78b5399ed3 tempest-VolumesActionsTest-2121574506 None] Volume detach called, but volume not attached.
Apr 20 17:36:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-de10fdf3-8a49-4a56-b0bf-dc78b5399ed3 tempest-VolumesActionsTest-2121574506 None] Lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:04 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" returned: 0 in 2.550s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2f5cb2-dbd2-42ef-a179-e7e15b29d73d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "cinder-quobyte-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Lock "cinder-quobyte-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[646d6058-4cea-4ab3-b802-79d19d755508]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:04 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33
Apr 20 17:36:04 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:04 devstack sudo[89100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e
Apr 20 17:36:04 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:04 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e" returned: 0 in 0.484s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:04 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e
Apr 20 17:36:04 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:05 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33" returned: 0 in 0.618s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33, size 1024.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:36:05 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Converted 1024.00 MB image at 401.40 MB/s
Apr 20 17:36:05 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662 is being set with open permissions: ugo+rw
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:05 devstack sudo[89111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662
Apr 20 17:36:05 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:05 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e" returned: 0 in 0.419s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Lock "cinder-quobyte-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e" released by "delete_volume" :: held 0.925s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Created reservations ['11413186-99d1-49da-86e8-1e352b224683', 'c13e7030-6ca7-4c2b-ad24-75aa4f3737fc', '4a3255a7-1a5d-4687-ab97-7ddc2841c711', '1e333116-3b6e-401a-a47f-c785e193d8bf'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:05 devstack sudo[89115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:05 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:05 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" returned: 0 in 0.450s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" released by "_copy_volume_from_snapshot" :: held 4.660s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-75f961e8-9759-4d2a-99d5-3931e932db17-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" released by "_create_volume_from_snapshot" :: held 4.678s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.686s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991049e6-c191-4be4-8601-d755b76e09a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662', 'volume_size': 1, 'snapshot_id': '75f961e8-9759-4d2a-99d5-3931e932db17'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef7ff5f-21a3-44d1-ac19-bc6e3dd9d22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:05 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Volume volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662 (4c0453d7-85dc-4dfe-ac81-9bbfc7c50662): created successfully
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef7ff5f-21a3-44d1-ac19-bc6e3dd9d22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Flow 'volume_create_manager' (22405b80-2e0a-4872-87f5-12564df95306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:05 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c4712d88-c583-4c70-8d0d-b818c55b183b tempest-VolumesSnapshotTestJSON-157764661 None] Created volume successfully.
Apr 20 17:36:05 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.437s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:05 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Deleted volume successfully.
Apr 20 17:36:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e78ca9cb-f5ad-4507-8b9b-c7fb9ac0d795 tempest-VolumesActionsTest-2121574506 None] Lock "cinder-4f057bdd-6ce3-4d3e-b7d4-cc15fa5da34e-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" acquired by "delete_volume" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:06 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ec6032-b559-4ac9-9de9-1f889a4e15f8]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:06 devstack sudo[89120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662
Apr 20 17:36:06 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:06 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" returned: 0 in 0.560s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:06 devstack sudo[89150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662
Apr 20 17:36:06 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:07 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" returned: 0 in 0.434s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662" released by "delete_volume" :: held 1.017s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Created reservations ['e494c901-d6fb-46fb-a2a8-98c25f1c77fd', 'fca3f128-d041-405e-b288-a40451fd76fc', '9adb76e1-5137-4ccc-b7ff-7866c773621b', '07d038db-430a-4599-b9e3-35b2250eff0d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:07 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:07 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:07 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.400s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:07 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Deleted volume successfully.
Apr 20 17:36:07 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0940e5d3-62dc-41b3-a629-c69560771e8e tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-4c0453d7-85dc-4dfe-ac81-9bbfc7c50662-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-75f961e8-9759-4d2a-99d5-3931e932db17-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-75f961e8-9759-4d2a-99d5-3931e932db17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-256b2a15-73b9-43bb-ad87-e934fe017f33" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-256b2a15-73b9-43bb-ad87-e934fe017f33" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-75f961e8-9759-4d2a-99d5-3931e932db17" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-75f961e8-9759-4d2a-99d5-3931e932db17" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Deleting offline snapshot 75f961e8-9759-4d2a-99d5-3931e932db17 of volume 256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] snapshot_file for this snap is: volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[59534f0a-27f5-46cf-ac17-0b79d0d47112]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:08 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17
Apr 20 17:36:08 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:09 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17" returned: 0 in 0.483s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-256b2a15-73b9-43bb-ad87-e934fe017f33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:36:09 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdc68cc-8f18-4857-a3eb-eb8430e99fc4]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:09 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33
Apr 20 17:36:09 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:09 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33" returned: 0 in 0.504s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:09 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17
Apr 20 17:36:09 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:10 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17" returned: 0 in 0.451s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:10 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17
Apr 20 17:36:10 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:10 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33.75f961e8-9759-4d2a-99d5-3931e932db17" returned: 0 in 0.443s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-75f961e8-9759-4d2a-99d5-3931e932db17" released by "_delete_snapshot" :: held 1.936s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-256b2a15-73b9-43bb-ad87-e934fe017f33" released by "delete_snapshot" :: held 1.949s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Created reservations ['fdd0776d-1f22-41f0-bbca-d3c3bbcdb961', '13fe57c6-5cb3-45fd-9c64-a8fec3c06cde', '072edda5-b3fd-4eb7-9388-bee7fae123e0', 'a1749269-5af5-4a8f-b56e-0af1ebc445f4'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Delete snapshot completed successfully.
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-00da646d-601a-466e-81b5-66fc255e3e36 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-75f961e8-9759-4d2a-99d5-3931e932db17-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-256b2a15-73b9-43bb-ad87-e934fe017f33-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-256b2a15-73b9-43bb-ad87-e934fe017f33-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-256b2a15-73b9-43bb-ad87-e934fe017f33" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-256b2a15-73b9-43bb-ad87-e934fe017f33" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85234e0-0452-4e1a-9228-973ea9459a36]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:10 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33
Apr 20 17:36:10 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:11 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:11 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33
Apr 20 17:36:11 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:11 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-256b2a15-73b9-43bb-ad87-e934fe017f33" returned: 0 in 0.461s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-256b2a15-73b9-43bb-ad87-e934fe017f33" released by "delete_volume" :: held 0.960s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (647e3a00-393b-43c2-ae9c-e3b74f8e1fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a959cc-bea0-48ab-960b-e4d1cbc11757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a959cc-bea0-48ab-960b-e4d1cbc11757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-745735327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b303f499-7b3f-4e6f-bae9-7c536ece699f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:12Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8863142e-b6fe-47b9-b3fb-7494c33e6915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8863142e-b6fe-47b9-b3fb-7494c33e6915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3e9386-2128-4210-90ad-b041b6ddf5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3e9386-2128-4210-90ad-b041b6ddf5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b303f499-7b3f-4e6f-bae9-7c536ece699f', 'volume_name': 'volume-b303f499-7b3f-4e6f-bae9-7c536ece699f', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3044760d-90ec-4b95-a022-0b8dbe82ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3044760d-90ec-4b95-a022-0b8dbe82ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8d3c97-998d-4ac9-8bab-c3981272c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:11 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Volume b303f499-7b3f-4e6f-bae9-7c536ece699f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b303f499-7b3f-4e6f-bae9-7c536ece699f', 'volume_size': 1}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-745735327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b303f499-7b3f-4e6f-bae9-7c536ece699f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:12Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Creating volume b303f499-7b3f-4e6f-bae9-7c536ece699f {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:11 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:11 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f 1073741824
Apr 20 17:36:11 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Created reservations ['5daf1ea6-c82b-40e4-b638-6d8bed39f66d', '1584353a-b5b1-4810-9342-c5b5e90a382d', 'adc17f5d-76b5-4f00-abe9-95209c97274f', 'c39f0cc5-07f5-4b7b-8068-369b925bd144'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:11 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:11 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:12 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f 1073741824" returned: 0 in 0.483s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:12 devstack sudo[89193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f
Apr 20 17:36:12 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:12 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.451s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Deleted volume successfully.
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-53cc540e-1ce0-467d-9c7d-8f7b9b675fc9 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-256b2a15-73b9-43bb-ad87-e934fe017f33-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:12 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f" returned: 0 in 0.428s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8d3c97-998d-4ac9-8bab-c3981272c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b303f499-7b3f-4e6f-bae9-7c536ece699f', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9380fe-cd03-4bfd-bf0d-84d0326e35d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:12 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Volume volume-b303f499-7b3f-4e6f-bae9-7c536ece699f (b303f499-7b3f-4e6f-bae9-7c536ece699f): created successfully
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9380fe-cd03-4bfd-bf0d-84d0326e35d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (647e3a00-393b-43c2-ae9c-e3b74f8e1fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e52ca7f6-88d0-4298-bfc7-ec456276e138 tempest-VolumesActionsTest-2121574506 None] Created volume successfully.
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-4c9023ba-8eb2-467d-91ce-f0c29b51ee76-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-4c9023ba-8eb2-467d-91ce-f0c29b51ee76-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "cinder-quobyte-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cb0697-0f84-42f2-9f33-bb57c18ead29]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:13 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76
Apr 20 17:36:13 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:13 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:13 devstack sudo[89201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76
Apr 20 17:36:13 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:13 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" returned: 0 in 0.432s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-quobyte-4c9023ba-8eb2-467d-91ce-f0c29b51ee76" released by "delete_volume" :: held 0.938s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:13 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Created reservations ['6b90a3bd-0bf5-4028-ac83-0e0f482d0147', '0aa00445-a89f-4a1d-a65c-57c32e7d4fcd', '92e04b20-2a75-42c6-bed1-d1341c21e63d', '8f78570a-bb90-4bab-9427-513fc4044170'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Acquiring lock "cinder-b303f499-7b3f-4e6f-bae9-7c536ece699f-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Lock "cinder-b303f499-7b3f-4e6f-bae9-7c536ece699f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:13 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Acquiring lock "cinder-quobyte-b303f499-7b3f-4e6f-bae9-7c536ece699f" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Lock "cinder-quobyte-b303f499-7b3f-4e6f-bae9-7c536ece699f" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f83d0ab-22d1-4ee2-951a-468b9ae96ca3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:14 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:14 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:14 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f
Apr 20 17:36:14 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:14 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.434s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:14 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Deleted volume successfully.
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-98b1f0e2-044a-4e23-b1e9-0a50276e09d6 tempest-VolumesSnapshotTestJSON-157764661 None] Lock "cinder-4c9023ba-8eb2-467d-91ce-f0c29b51ee76-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:14 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f" returned: 0 in 0.487s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:14 devstack sudo[89212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f
Apr 20 17:36:14 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:14 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b303f499-7b3f-4e6f-bae9-7c536ece699f" returned: 0 in 0.439s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Lock "cinder-quobyte-b303f499-7b3f-4e6f-bae9-7c536ece699f" released by "delete_volume" :: held 0.952s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:14 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Created reservations ['b8f68306-d921-4134-b5c5-11c9e3ad8697', 'a1715dce-81f6-4d42-9331-f2d09b57e896', '6ec7a47f-4b5e-4a27-9f2f-ce7018d9ba28', '626605d5-5200-4ec1-bfa6-a2e31fb1d6d0'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:15 devstack sudo[89216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:15 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (29a0058f-83de-43dc-8dec-db5b46542c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccaa0b3-e917-44fd-b05d-e6d8b44f75c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccaa0b3-e917-44fd-b05d-e6d8b44f75c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1078704233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52eeca0f-35fe-45ac-93f4-7c58bb59c92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:15Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479a6d67-0463-407f-bb25-f4eb8c18ff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479a6d67-0463-407f-bb25-f4eb8c18ff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aa0948-df86-400a-a2aa-122b165daebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8aa0948-df86-400a-a2aa-122b165daebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52eeca0f-35fe-45ac-93f4-7c58bb59c92a', 'volume_name': 'volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4247d29d-3f00-4d73-a8d5-bc0695349f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4247d29d-3f00-4d73-a8d5-bc0695349f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d8eaaa-4f06-40ec-8b2f-9e0c9e05c09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:15 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Volume 52eeca0f-35fe-45ac-93f4-7c58bb59c92a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a', 'volume_size': 1}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1078704233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52eeca0f-35fe-45ac-93f4-7c58bb59c92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:15Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Creating volume 52eeca0f-35fe-45ac-93f4-7c58bb59c92a {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:15 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:15 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a 1073741824
Apr 20 17:36:15 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:15 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.498s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:15 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Deleted volume successfully.
Apr 20 17:36:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6b17140b-1eaa-4c2c-adba-06b6dac34d1b tempest-VolumesActionsTest-1986317312 None] Lock "cinder-b303f499-7b3f-4e6f-bae9-7c536ece699f-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:15 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a 1073741824" returned: 0 in 0.529s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:16 devstack sudo[89226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a
Apr 20 17:36:16 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:16 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a" returned: 0 in 0.493s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d8eaaa-4f06-40ec-8b2f-9e0c9e05c09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21bde4d-cfb5-4c0c-9a77-ff516da69ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:16 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Volume volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a (52eeca0f-35fe-45ac-93f4-7c58bb59c92a): created successfully
Apr 20 17:36:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21bde4d-cfb5-4c0c-9a77-ff516da69ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:16 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (29a0058f-83de-43dc-8dec-db5b46542c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:16 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-21a1555c-60ea-4ede-a18b-ed37f6346cf3 tempest-VolumesActionsTest-2121574506 None] Created volume successfully.
Apr 20 17:36:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Acquiring lock "cinder-52eeca0f-35fe-45ac-93f4-7c58bb59c92a-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Lock "cinder-52eeca0f-35fe-45ac-93f4-7c58bb59c92a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Acquiring lock "cinder-quobyte-52eeca0f-35fe-45ac-93f4-7c58bb59c92a" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Lock "cinder-quobyte-52eeca0f-35fe-45ac-93f4-7c58bb59c92a" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:17 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e4dd0a-57a4-4566-a390-011111835fe2]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:17 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a
Apr 20 17:36:17 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:18 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:18 devstack sudo[89236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a
Apr 20 17:36:18 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:18 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-52eeca0f-35fe-45ac-93f4-7c58bb59c92a" returned: 0 in 0.412s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Lock "cinder-quobyte-52eeca0f-35fe-45ac-93f4-7c58bb59c92a" released by "delete_volume" :: held 0.923s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Created reservations ['63eebd0e-5b7c-439a-86f1-e446b9dca652', 'd7fe6ecf-d7a7-4763-a6aa-cbb3659d9012', 'd48b7709-69df-423e-b915-61d993afa539', 'c2d44b0e-d403-45d9-af13-36283de4a896'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:18 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:18 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (85b0cda7-b6da-4f61-beec-fffe5c57b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da49b410-40a4-4b52-b32b-8568e9ea2faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da49b410-40a4-4b52-b32b-8568e9ea2faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-567988017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecf466e-3a2b-439a-943f-42ec75a228a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:19Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4120ff-29c9-4438-a5ce-d82d2f8f15e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4120ff-29c9-4438-a5ce-d82d2f8f15e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe1ebb8-b9db-4596-813b-da92a2d51d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe1ebb8-b9db-4596-813b-da92a2d51d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecf466e-3a2b-439a-943f-42ec75a228a9', 'volume_name': 'volume-0ecf466e-3a2b-439a-943f-42ec75a228a9', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20768beb-ed15-410c-b7b2-c4363f18f462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20768beb-ed15-410c-b7b2-c4363f18f462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de9eab7-8a03-4557-93ca-50daad994382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:19 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Volume 0ecf466e-3a2b-439a-943f-42ec75a228a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecf466e-3a2b-439a-943f-42ec75a228a9', 'volume_size': 1}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-567988017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecf466e-3a2b-439a-943f-42ec75a228a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:19Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Creating volume 0ecf466e-3a2b-439a-943f-42ec75a228a9 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:19 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:19 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.442s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:19 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Deleted volume successfully.
Apr 20 17:36:19 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9 1073741824
Apr 20 17:36:19 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0c6a8e70-eb9a-4428-bc76-12da7e65bc4f tempest-VolumesActionsTest-1986317312 None] Lock "cinder-52eeca0f-35fe-45ac-93f4-7c58bb59c92a-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:19 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9 1073741824" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:19 devstack sudo[89247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9
Apr 20 17:36:19 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:20 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9" returned: 0 in 0.412s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de9eab7-8a03-4557-93ca-50daad994382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecf466e-3a2b-439a-943f-42ec75a228a9', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4514ff9c-c92f-4c9e-8290-4e3169870edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:20 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Volume volume-0ecf466e-3a2b-439a-943f-42ec75a228a9 (0ecf466e-3a2b-439a-943f-42ec75a228a9): created successfully
Apr 20 17:36:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4514ff9c-c92f-4c9e-8290-4e3169870edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (85b0cda7-b6da-4f61-beec-fffe5c57b859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:20 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-81fb8347-4611-4cae-a21b-e848bea1950a tempest-VolumesActionsTest-2121574506 None] Created volume successfully.
Apr 20 17:36:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Acquiring lock "cinder-0ecf466e-3a2b-439a-943f-42ec75a228a9-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-0ecf466e-3a2b-439a-943f-42ec75a228a9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Acquiring lock "cinder-quobyte-0ecf466e-3a2b-439a-943f-42ec75a228a9" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-quobyte-0ecf466e-3a2b-439a-943f-42ec75a228a9" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:21 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b423a560-b341-4901-b717-a6e7a41da354]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:21 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9
Apr 20 17:36:21 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:21 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9" returned: 0 in 0.473s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:21 devstack sudo[89255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9
Apr 20 17:36:21 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:22 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0ecf466e-3a2b-439a-943f-42ec75a228a9" returned: 0 in 0.408s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-quobyte-0ecf466e-3a2b-439a-943f-42ec75a228a9" released by "delete_volume" :: held 0.902s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Created reservations ['c46d48fa-f509-4bda-b02d-83698e31bae4', 'aa0a388b-f17a-4a37-91af-7a7dc875e628', '5debd6b3-991d-4ce7-bd79-5c331399fcef', 'f067712c-2df6-4e68-8708-33c44fe14839'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:22 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:22 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (64e65e88-d202-403c-b9c8-d0da0e53b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bedf111-09d5-4399-b76d-c1a218068f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bedf111-09d5-4399-b76d-c1a218068f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1921778993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:23Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f48118b-2cd2-4a9e-8a42-ac7f802224f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f48118b-2cd2-4a9e-8a42-ac7f802224f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f12e0d-37fa-43d5-b243-f7f2d5055024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f12e0d-37fa-43d5-b243-f7f2d5055024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e', 'volume_name': 'volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c87f81c-eedd-43ff-a575-faba9af0f113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c87f81c-eedd-43ff-a575-faba9af0f113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d413cae-09bb-46d4-a780-c25e1612ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:22 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Volume 6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e', 'volume_size': 1}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:22 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1921778993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:23Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Creating volume 6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:22 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.468s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Deleted volume successfully.
Apr 20 17:36:22 devstack sudo[89261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e 1073741824
Apr 20 17:36:22 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-369a27be-9f0b-4179-a2e9-49970c136982 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-0ecf466e-3a2b-439a-943f-42ec75a228a9-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:23 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e 1073741824" returned: 0 in 0.477s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:23 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e
Apr 20 17:36:23 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:23 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e" returned: 0 in 0.431s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:23 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d413cae-09bb-46d4-a780-c25e1612ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:23 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6aa665-79d6-453f-9e64-c230eb411d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:23 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Volume volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e (6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e): created successfully
Apr 20 17:36:23 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6aa665-79d6-453f-9e64-c230eb411d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:23 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (64e65e88-d202-403c-b9c8-d0da0e53b812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:23 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7b52b061-5418-40fa-b425-e52601191e93 tempest-VolumesActionsTest-2121574506 None] Created volume successfully.
Apr 20 17:36:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Acquiring lock "cinder-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Acquiring lock "cinder-quobyte-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-quobyte-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:24 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[49af92a2-0946-41f0-9436-dfc2b4949dae]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:24 devstack sudo[89269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e
Apr 20 17:36:24 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:25 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e" returned: 0 in 0.480s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:25 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e
Apr 20 17:36:25 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:25 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e" returned: 0 in 0.428s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-quobyte-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e" released by "delete_volume" :: held 0.930s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Created reservations ['2ece1784-d961-4e79-858d-c1783c2d521c', 'a5f79d8e-6c0f-45ef-942e-838d94794a07', '1a233ad9-fdcf-4b4f-b178-b8e336f7e8fe', '89204483-33c0-4be8-892e-7e683af48b1e'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:25 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:25 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (845628ba-bfcf-481e-b998-8639283b0b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2163a5-ff37-49cb-882e-186028f0481d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2163a5-ff37-49cb-882e-186028f0481d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1813766944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5ca086-cfb4-46a1-952b-49d6099823b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:26Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18774eb-d0e9-4120-8ff8-d2f1cf7280ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f18774eb-d0e9-4120-8ff8-d2f1cf7280ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcf4a60-969e-474a-a50c-e5663b89054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcf4a60-969e-474a-a50c-e5663b89054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5ca086-cfb4-46a1-952b-49d6099823b3', 'volume_name': 'volume-fa5ca086-cfb4-46a1-952b-49d6099823b3', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717b076c-469f-4a07-93f8-e27b7c649aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717b076c-469f-4a07-93f8-e27b7c649aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b6a76b-465b-4f60-b569-efe5d1e49d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:26 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Volume fa5ca086-cfb4-46a1-952b-49d6099823b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5ca086-cfb4-46a1-952b-49d6099823b3', 'volume_size': 1}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1813766944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5ca086-cfb4-46a1-952b-49d6099823b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c614ef0cbf8a4f8cb777e32e4cc08c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:26Z,use_quota=True,user_id='479f2f9577924c8e9620d565d64ed918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Creating volume fa5ca086-cfb4-46a1-952b-49d6099823b3 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:26 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:26 devstack sudo[89281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3 1073741824
Apr 20 17:36:26 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:26 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.438s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:26 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Deleted volume successfully.
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fcf2055e-b2da-49d7-ba90-497f466696d1 tempest-VolumesActionsTest-1986317312 None] Lock "cinder-6fa3ed2b-4720-41eb-bfbb-489ae8eabb9e-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:26 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3 1073741824" returned: 0 in 0.482s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:26 devstack sudo[89286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3
Apr 20 17:36:26 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:27 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3" returned: 0 in 0.417s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b6a76b-465b-4f60-b569-efe5d1e49d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5ca086-cfb4-46a1-952b-49d6099823b3', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f013e832-feea-4566-a378-d8e21397016b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:27 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Volume volume-fa5ca086-cfb4-46a1-952b-49d6099823b3 (fa5ca086-cfb4-46a1-952b-49d6099823b3): created successfully
Apr 20 17:36:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f013e832-feea-4566-a378-d8e21397016b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Flow 'volume_create_manager' (845628ba-bfcf-481e-b998-8639283b0b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:27 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-94d8fd0e-5cc9-44fc-a7e1-0b2437593dba tempest-VolumesActionsTest-2121574506 None] Created volume successfully.
Apr 20 17:36:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Acquiring lock "cinder-fa5ca086-cfb4-46a1-952b-49d6099823b3-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Lock "cinder-fa5ca086-cfb4-46a1-952b-49d6099823b3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Acquiring lock "cinder-quobyte-fa5ca086-cfb4-46a1-952b-49d6099823b3" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Lock "cinder-quobyte-fa5ca086-cfb4-46a1-952b-49d6099823b3" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:28 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d17ba1a-f684-43d2-a3b8-59fca0b78f9e]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:28 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3
Apr 20 17:36:28 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:29 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:29 devstack sudo[89294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3
Apr 20 17:36:29 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:29 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fa5ca086-cfb4-46a1-952b-49d6099823b3" returned: 0 in 0.413s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Lock "cinder-quobyte-fa5ca086-cfb4-46a1-952b-49d6099823b3" released by "delete_volume" :: held 0.911s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Created reservations ['ab4b1dac-fceb-433e-8b58-5dc700aa9349', '22e70c50-8de3-4d2f-9e35-de890c07e35d', 'fef1d5dd-0da8-4216-9c39-8940e8dad123', 'baddd20b-e796-4949-b21a-5cb0edc84b2a'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:29 devstack sudo[89297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:29 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:30 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.435s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:30 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:30 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Deleted volume successfully.
Apr 20 17:36:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cfce8ce4-af54-441c-9463-1d11fff45abc tempest-VolumesActionsTest-2121574506 None] Lock "cinder-fa5ca086-cfb4-46a1-952b-49d6099823b3-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Flow 'volume_create_manager' (e56837b4-2879-45b3-a141-21c3b5122086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b01106-1d7b-45b0-a3de-96a48d3e5e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b01106-1d7b-45b0-a3de-96a48d3e5e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-508756564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2f94fc-591d-4f52-a3fb-8cce192a99ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f44210866ec496aa9cea6d7ca63253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:37Z,use_quota=True,user_id='4c087a4a1ee44033989bcc4cef833413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c2058d-e894-4a65-8196-cd9c50c67688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c2058d-e894-4a65-8196-cd9c50c67688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f329e57-85a6-4703-a36e-a3f33d248f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f329e57-85a6-4703-a36e-a3f33d248f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d2f94fc-591d-4f52-a3fb-8cce192a99ff', 'volume_name': 'volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a53ed1b-3db5-4789-9881-b333090fcbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a53ed1b-3db5-4789-9881-b333090fcbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1940c5aa-fbaf-4d1c-9f91-7707dde61898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:36 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Volume 8d2f94fc-591d-4f52-a3fb-8cce192a99ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff', 'volume_size': 1}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-508756564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2f94fc-591d-4f52-a3fb-8cce192a99ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f44210866ec496aa9cea6d7ca63253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:37Z,use_quota=True,user_id='4c087a4a1ee44033989bcc4cef833413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Creating volume 8d2f94fc-591d-4f52-a3fb-8cce192a99ff {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:36 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:36 devstack sudo[89305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff 1073741824
Apr 20 17:36:36 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:37 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff 1073741824" returned: 0 in 0.476s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:37 devstack sudo[89310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff
Apr 20 17:36:37 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:37 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff" returned: 0 in 0.414s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1940c5aa-fbaf-4d1c-9f91-7707dde61898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7992ac81-d11e-417f-9f83-2b47f3c4d745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:37 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Volume volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff (8d2f94fc-591d-4f52-a3fb-8cce192a99ff): created successfully
Apr 20 17:36:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7992ac81-d11e-417f-9f83-2b47f3c4d745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Flow 'volume_create_manager' (e56837b4-2879-45b3-a141-21c3b5122086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-bcbdbe44-3d87-4887-b98a-044274b6ad44 tempest-VolumesListAdminTestJSON-1006838002 None] Created volume successfully.
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Flow 'volume_create_manager' (3c1a031f-f8a0-451f-8fa3-e791bf518eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70ed8db-1fd6-4ea8-be3d-e1ffb0772777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70ed8db-1fd6-4ea8-be3d-e1ffb0772777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1598718836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f44210866ec496aa9cea6d7ca63253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:39Z,use_quota=True,user_id='4c087a4a1ee44033989bcc4cef833413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea506ba-b9bb-4cbb-9c1f-4cb7bd6fc7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea506ba-b9bb-4cbb-9c1f-4cb7bd6fc7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9888c70-42c9-4921-ab0f-870fb984cc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9888c70-42c9-4921-ab0f-870fb984cc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b', 'volume_name': 'volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d467831-e3e7-47a3-abbf-dde59f2cac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d467831-e3e7-47a3-abbf-dde59f2cac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2973da76-8533-4abf-844c-24767bab7459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:39 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Volume 9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b', 'volume_size': 1}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1598718836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f44210866ec496aa9cea6d7ca63253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:39Z,use_quota=True,user_id='4c087a4a1ee44033989bcc4cef833413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Creating volume 9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:39 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:39 devstack sudo[89313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b 1073741824
Apr 20 17:36:39 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:39 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b 1073741824" returned: 0 in 0.468s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:39 devstack sudo[89318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b
Apr 20 17:36:39 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:40 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b" returned: 0 in 0.397s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2973da76-8533-4abf-844c-24767bab7459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342fd3d2-9859-4cf1-a15c-f80001b8ef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:40 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Volume volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b (9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b): created successfully
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342fd3d2-9859-4cf1-a15c-f80001b8ef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Flow 'volume_create_manager' (3c1a031f-f8a0-451f-8fa3-e791bf518eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:40 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f81af4dd-a80b-49b6-a64c-b664bb68105a tempest-VolumesListAdminTestJSON-1006838002 None] Created volume successfully.
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Flow 'volume_create_manager' (feac8f80-bf40-48f0-b1b3-2105925ac055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd205606-f874-49db-bdd3-0f4ea6e2fa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd205606-f874-49db-bdd3-0f4ea6e2fa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1378105195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1708bc73-3fba-46d3-9d18-a6294200c815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f44210866ec496aa9cea6d7ca63253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:40Z,use_quota=True,user_id='4c087a4a1ee44033989bcc4cef833413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2d0ca6-13e4-4fd8-a73e-48b63af67e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2d0ca6-13e4-4fd8-a73e-48b63af67e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156a888d-0949-4d2a-9420-121815a3b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156a888d-0949-4d2a-9420-121815a3b63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1708bc73-3fba-46d3-9d18-a6294200c815', 'volume_name': 'volume-1708bc73-3fba-46d3-9d18-a6294200c815', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5d67a3-3397-4175-bd09-0078621f7a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5d67a3-3397-4175-bd09-0078621f7a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca912626-5262-4a1f-bb35-3865e77ba350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:40 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Volume 1708bc73-3fba-46d3-9d18-a6294200c815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1708bc73-3fba-46d3-9d18-a6294200c815', 'volume_size': 1}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1378105195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1708bc73-3fba-46d3-9d18-a6294200c815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f44210866ec496aa9cea6d7ca63253e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:40Z,use_quota=True,user_id='4c087a4a1ee44033989bcc4cef833413',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Creating volume 1708bc73-3fba-46d3-9d18-a6294200c815 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:40 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:40 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815 1073741824
Apr 20 17:36:40 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:40 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815 1073741824" returned: 0 in 0.474s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:41 devstack sudo[89326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815
Apr 20 17:36:41 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:41 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815" returned: 0 in 0.403s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca912626-5262-4a1f-bb35-3865e77ba350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1708bc73-3fba-46d3-9d18-a6294200c815', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2a7205-27ea-4a8f-aea7-7f17d4362196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:41 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Volume volume-1708bc73-3fba-46d3-9d18-a6294200c815 (1708bc73-3fba-46d3-9d18-a6294200c815): created successfully
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2a7205-27ea-4a8f-aea7-7f17d4362196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Flow 'volume_create_manager' (feac8f80-bf40-48f0-b1b3-2105925ac055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:41 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-2524cbc4-0748-400c-9140-5597f6d6ba36 tempest-VolumesListAdminTestJSON-1006838002 None] Created volume successfully.
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Flow 'volume_create_manager' (5e309528-4997-4f7c-9806-eda025b8702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5ce6f5-cc42-4c9f-ae91-a4fb2ba98a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5ce6f5-cc42-4c9f-ae91-a4fb2ba98a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75849c32-d103-4c9a-9907-e2c0978c46b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a0698c10a24597b34294e550b2827d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:42Z,use_quota=True,user_id='761609c158624996ad6bdd87e61be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc71b61-de81-4125-9f88-8a2815e8f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc71b61-de81-4125-9f88-8a2815e8f07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3821e711-efb5-44bf-b686-db017fe648b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3821e711-efb5-44bf-b686-db017fe648b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75849c32-d103-4c9a-9907-e2c0978c46b9', 'volume_name': 'volume-75849c32-d103-4c9a-9907-e2c0978c46b9', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f94311-bc8b-4b86-9e32-cb5e15faeefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f94311-bc8b-4b86-9e32-cb5e15faeefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496fe9e2-ef05-4887-984b-6b55ea12c6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:41 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Volume 75849c32-d103-4c9a-9907-e2c0978c46b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75849c32-d103-4c9a-9907-e2c0978c46b9', 'volume_size': 1}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75849c32-d103-4c9a-9907-e2c0978c46b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a0698c10a24597b34294e550b2827d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:42Z,use_quota=True,user_id='761609c158624996ad6bdd87e61be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Creating volume 75849c32-d103-4c9a-9907-e2c0978c46b9 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:41 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:41 devstack sudo[89329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9 1073741824
Apr 20 17:36:41 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:42 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9 1073741824" returned: 0 in 0.474s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:42 devstack sudo[89334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9
Apr 20 17:36:42 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:42 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9" returned: 0 in 0.428s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496fe9e2-ef05-4887-984b-6b55ea12c6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75849c32-d103-4c9a-9907-e2c0978c46b9', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d66ae4-e22a-45c4-b28e-faaba94feaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:42 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Volume volume-75849c32-d103-4c9a-9907-e2c0978c46b9 (75849c32-d103-4c9a-9907-e2c0978c46b9): created successfully
Apr 20 17:36:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d66ae4-e22a-45c4-b28e-faaba94feaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:42 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Flow 'volume_create_manager' (5e309528-4997-4f7c-9806-eda025b8702c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ffc85f9d-0d39-46aa-a620-a5fd7d043914 tempest-VolumesListAdminTestJSON-1698802513 None] Created volume successfully.
Apr 20 17:36:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:36:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:43 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:43 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:43 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.411s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Acquiring lock "cinder-75849c32-d103-4c9a-9907-e2c0978c46b9-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "cinder-75849c32-d103-4c9a-9907-e2c0978c46b9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Acquiring lock "cinder-quobyte-75849c32-d103-4c9a-9907-e2c0978c46b9" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "cinder-quobyte-75849c32-d103-4c9a-9907-e2c0978c46b9" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63365ca-c679-4656-a64f-df3f3f034479]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "cinder-1708bc73-3fba-46d3-9d18-a6294200c815-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-1708bc73-3fba-46d3-9d18-a6294200c815-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:44 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9
Apr 20 17:36:44 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "cinder-quobyte-1708bc73-3fba-46d3-9d18-a6294200c815" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-quobyte-1708bc73-3fba-46d3-9d18-a6294200c815" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed9ba2b-e700-4060-aa42-476a6ce2a755]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:44 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815
Apr 20 17:36:44 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:44 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9" returned: 0 in 0.497s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:44 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9
Apr 20 17:36:44 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:44 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815" returned: 0 in 0.501s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:44 devstack sudo[89354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815
Apr 20 17:36:44 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:45 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-75849c32-d103-4c9a-9907-e2c0978c46b9" returned: 0 in 0.432s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "cinder-quobyte-75849c32-d103-4c9a-9907-e2c0978c46b9" released by "delete_volume" :: held 0.963s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Created reservations ['34a7bdd8-d0c0-4b4d-9d80-3f0317bdcd98', 'd27c4b87-c3ee-4bf0-9925-619fef2ce662', '5c47a7d6-8eea-48c9-9007-7c58eb5fe01e', 'b28a7795-4a7a-4514-86a7-594becf84fc8'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:45 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1708bc73-3fba-46d3-9d18-a6294200c815" returned: 0 in 0.421s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:45 devstack sudo[89358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:45 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-quobyte-1708bc73-3fba-46d3-9d18-a6294200c815" released by "delete_volume" :: held 0.952s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Created reservations ['b9a968b4-98f6-4c30-9ee5-37709ef591f5', 'c2e9dc29-c223-4774-b225-36f8a3d6210c', '5d66f9e9-23fc-421a-b296-0856e52c5321', '231759cb-eb8c-45a5-83b7-43b58eb951c0'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:45 devstack sudo[89360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:45 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "cinder-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "cinder-quobyte-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-quobyte-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b" acquired by "delete_volume" :: waited 0.019s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cc1f59-a3ed-4ef1-8432-18d249728d04]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:45 devstack sudo[89362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b
Apr 20 17:36:45 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:45 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.453s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:45 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Deleted volume successfully.
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-60349113-ca0b-4704-ac87-9c263ec461c8 tempest-VolumesListAdminTestJSON-1698802513 None] Lock "cinder-75849c32-d103-4c9a-9907-e2c0978c46b9-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:45 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.440s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:45 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Deleted volume successfully.
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-af167f90-68d6-42f7-a8e5-0798060565d0 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-1708bc73-3fba-46d3-9d18-a6294200c815-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:45 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b" returned: 0 in 0.498s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:45 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b
Apr 20 17:36:45 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:46 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b" returned: 0 in 0.405s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-quobyte-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b" released by "delete_volume" :: held 0.925s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Created reservations ['614470eb-e160-461a-85fe-67aa2a9a3e30', 'fc2f7397-b8c1-485a-8b61-f470f0cdf31a', '3ea28c3a-f091-4265-beff-c606ef938093', '43caeb8e-8033-4449-accc-7ffc42f987d7'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:46 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:46 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "cinder-8d2f94fc-591d-4f52-a3fb-8cce192a99ff-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-8d2f94fc-591d-4f52-a3fb-8cce192a99ff-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "cinder-quobyte-8d2f94fc-591d-4f52-a3fb-8cce192a99ff" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-quobyte-8d2f94fc-591d-4f52-a3fb-8cce192a99ff" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e761862-2e69-454f-b1db-5df9a4eac6cd]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:46 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff
Apr 20 17:36:46 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:46 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.408s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:46 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Deleted volume successfully.
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-87d502a0-3231-4939-9f5b-c23592619f07 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-9d2739d5-c3a4-448f-b6d6-02a5c53b9c6b-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:46 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:47 devstack sudo[89381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff
Apr 20 17:36:47 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:47 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8d2f94fc-591d-4f52-a3fb-8cce192a99ff" returned: 0 in 0.416s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-quobyte-8d2f94fc-591d-4f52-a3fb-8cce192a99ff" released by "delete_volume" :: held 0.915s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Created reservations ['859b2cbc-1d5e-4624-ad42-4e9f1269808d', 'bd282a15-ddf8-49a4-bf7d-c02c9af2dfe3', '961ae9cc-4869-42be-9d2f-6b52826cc50a', 'f22820ed-222a-49dc-ab27-33d3bd04bc78'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:47 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:47 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:47 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.414s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:47 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Deleted volume successfully.
Apr 20 17:36:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-928ec41a-cfa4-4043-a238-4fc3754599e5 tempest-VolumesListAdminTestJSON-1006838002 None] Lock "cinder-8d2f94fc-591d-4f52-a3fb-8cce192a99ff-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Flow 'volume_create_manager' (968752f8-f8d5-4cae-8803-a6729376772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55673a9-1607-44f0-a796-cae0f4faff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55673a9-1607-44f0-a796-cae0f4faff29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-455830528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e922579b-2a75-4153-9c30-bc9ec5868fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64a06e1c3a2460cbb597f1d2a977124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:50Z,use_quota=True,user_id='823bc003d02f4ff2b6824b75753afc01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4e3f7d-8fe4-4fd8-811d-a5930bb00a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4e3f7d-8fe4-4fd8-811d-a5930bb00a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549dd669-2d73-48ba-9eb7-8b08a235927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549dd669-2d73-48ba-9eb7-8b08a235927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e922579b-2a75-4153-9c30-bc9ec5868fff', 'volume_name': 'volume-e922579b-2a75-4153-9c30-bc9ec5868fff', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8371e6-deb1-4bf2-bf99-bde0f5d50fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8371e6-deb1-4bf2-bf99-bde0f5d50fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335d96fe-46e4-4758-b156-21b3f0d4e39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:49 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Volume e922579b-2a75-4153-9c30-bc9ec5868fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e922579b-2a75-4153-9c30-bc9ec5868fff', 'volume_size': 1}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-455830528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e922579b-2a75-4153-9c30-bc9ec5868fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64a06e1c3a2460cbb597f1d2a977124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:50Z,use_quota=True,user_id='823bc003d02f4ff2b6824b75753afc01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Creating volume e922579b-2a75-4153-9c30-bc9ec5868fff {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:49 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:49 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff 1073741824
Apr 20 17:36:49 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:50 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff 1073741824" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:50 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff
Apr 20 17:36:50 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:50 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff" returned: 0 in 0.400s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:50 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335d96fe-46e4-4758-b156-21b3f0d4e39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e922579b-2a75-4153-9c30-bc9ec5868fff', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d8da2e-d86a-4a2c-bcb1-eb9ab3b5fc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:50 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Volume volume-e922579b-2a75-4153-9c30-bc9ec5868fff (e922579b-2a75-4153-9c30-bc9ec5868fff): created successfully
Apr 20 17:36:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d8da2e-d86a-4a2c-bcb1-eb9ab3b5fc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Flow 'volume_create_manager' (968752f8-f8d5-4cae-8803-a6729376772f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:50 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b0b86e7b-4a64-4ced-9994-5797e466f0b6 tempest-VolumesMetadataTest-1335903820 None] Created volume successfully.
Apr 20 17:36:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Acquiring lock "cinder-e922579b-2a75-4153-9c30-bc9ec5868fff-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Lock "cinder-e922579b-2a75-4153-9c30-bc9ec5868fff-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Acquiring lock "cinder-quobyte-e922579b-2a75-4153-9c30-bc9ec5868fff" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Lock "cinder-quobyte-e922579b-2a75-4153-9c30-bc9ec5868fff" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:51 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a527861-66d0-439b-9de5-63272d06303f]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:51 devstack sudo[89395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff
Apr 20 17:36:51 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:51 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff" returned: 0 in 0.454s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:51 devstack sudo[89400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff
Apr 20 17:36:51 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:52 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e922579b-2a75-4153-9c30-bc9ec5868fff" returned: 0 in 0.403s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Lock "cinder-quobyte-e922579b-2a75-4153-9c30-bc9ec5868fff" released by "delete_volume" :: held 0.885s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Created reservations ['f185e1c8-879e-457c-9008-717667a668c2', '28128a9e-408e-4cd3-b610-766fd035af2b', '1ee135d0-956f-4db3-b64b-0368eafda065', 'e72c26bc-5418-4069-a2bb-2ab5410c5f61'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:52 devstack sudo[89403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:52 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:52 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.447s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:52 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Deleted volume successfully.
Apr 20 17:36:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-84bffc57-17f1-4681-94fe-6ffa669ea584 tempest-VolumesMetadataTest-1335903820 None] Lock "cinder-e922579b-2a75-4153-9c30-bc9ec5868fff-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=127,cinder:UPDATE=169,cinder:INSERT=37,cinder:DELETE=16 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=130,cinder:INSERT=47,cinder:UPDATE=199,cinder:DELETE=15 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Flow 'volume_create_manager' (ee46139d-4cb6-4c09-98d5-ef4f46b22919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a14ec4-5d30-4b4a-94ce-5e72e95de4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a14ec4-5d30-4b4a-94ce-5e72e95de4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-838970928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f027c762-8f4b-4a1b-a178-9bdbd91b0f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee9a84cd0034052ab6719f03de30b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:55Z,use_quota=True,user_id='7b2205d76dd442b7a72ffe55fd876b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710b6515-94f6-42d9-8a30-bce8992d608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710b6515-94f6-42d9-8a30-bce8992d608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0c1601-386c-4d64-a0e9-1beedfa1d4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0c1601-386c-4d64-a0e9-1beedfa1d4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f027c762-8f4b-4a1b-a178-9bdbd91b0f05', 'volume_name': 'volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ffd3e5-e35f-447a-af59-e0468a091b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ffd3e5-e35f-447a-af59-e0468a091b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b8799a-5346-462d-a6e8-d46380d9b621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:54 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Volume f027c762-8f4b-4a1b-a178-9bdbd91b0f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05', 'volume_size': 1}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-838970928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f027c762-8f4b-4a1b-a178-9bdbd91b0f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee9a84cd0034052ab6719f03de30b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:55Z,use_quota=True,user_id='7b2205d76dd442b7a72ffe55fd876b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Creating volume f027c762-8f4b-4a1b-a178-9bdbd91b0f05 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:54 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:54 devstack sudo[89406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05 1073741824
Apr 20 17:36:54 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:55 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05 1073741824" returned: 0 in 0.455s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:55 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05
Apr 20 17:36:55 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:55 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05" returned: 0 in 0.407s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58b8799a-5346-462d-a6e8-d46380d9b621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0d093a-b1f7-4372-babf-bd8ccf4a27cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:55 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Volume volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05 (f027c762-8f4b-4a1b-a178-9bdbd91b0f05): created successfully
Apr 20 17:36:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0d093a-b1f7-4372-babf-bd8ccf4a27cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Flow 'volume_create_manager' (ee46139d-4cb6-4c09-98d5-ef4f46b22919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-edf5529d-8421-47af-972b-839d4f6a6601 tempest-VolumesTransfersTest-1708026462 None] Created volume successfully.
Apr 20 17:36:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-dcdfbc1f-6472-442d-8a25-5f3172b94aa1 tempest-VolumesTransfersTest-825590154 None] Transfer volume completed successfully.
Apr 20 17:36:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Acquiring lock "cinder-f027c762-8f4b-4a1b-a178-9bdbd91b0f05-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Lock "cinder-f027c762-8f4b-4a1b-a178-9bdbd91b0f05-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Acquiring lock "cinder-quobyte-f027c762-8f4b-4a1b-a178-9bdbd91b0f05" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Lock "cinder-quobyte-f027c762-8f4b-4a1b-a178-9bdbd91b0f05" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1431a356-3b92-4f14-a886-d18a1ce845f0]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:57 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05
Apr 20 17:36:57 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:57 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05" returned: 0 in 0.459s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:57 devstack sudo[89426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05
Apr 20 17:36:57 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:57 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f027c762-8f4b-4a1b-a178-9bdbd91b0f05" returned: 0 in 0.390s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Lock "cinder-quobyte-f027c762-8f4b-4a1b-a178-9bdbd91b0f05" released by "delete_volume" :: held 0.880s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Created reservations ['8107902d-9ea4-4a15-a1c1-9ef9da5324d9', 'a81f2539-b085-4a87-87a1-fd18bbd9d592', 'a4744a82-6ff9-45d7-ac5b-f92c5f3983d1', '6ac85ddb-62eb-436e-ba14-9155d41634fd'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:57 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:36:57 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:36:58 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Flow 'volume_create_manager' (f21eb273-2d51-4ba9-99ba-dc334c9d1e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e89fe2-ad8b-4237-9c97-cc3bc1cd7c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.447s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e89fe2-ad8b-4237-9c97-cc3bc1cd7c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1387845673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccebca28-48b8-4783-92c5-44c11636de1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee9a84cd0034052ab6719f03de30b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:58Z,use_quota=True,user_id='7b2205d76dd442b7a72ffe55fd876b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c5e431-3988-4d48-9b63-4a10ca6af076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c5e431-3988-4d48-9b63-4a10ca6af076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92db7ca5-808b-4135-9786-d6859bdebd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92db7ca5-808b-4135-9786-d6859bdebd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccebca28-48b8-4783-92c5-44c11636de1e', 'volume_name': 'volume-ccebca28-48b8-4783-92c5-44c11636de1e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf1eff-ec27-4bb6-b1e5-3498cfac8fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf1eff-ec27-4bb6-b1e5-3498cfac8fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254ea09c-2c6a-43a1-8b34-7aba0ededf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:58 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Volume ccebca28-48b8-4783-92c5-44c11636de1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccebca28-48b8-4783-92c5-44c11636de1e', 'volume_size': 1}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1387845673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccebca28-48b8-4783-92c5-44c11636de1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee9a84cd0034052ab6719f03de30b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:36:58Z,use_quota=True,user_id='7b2205d76dd442b7a72ffe55fd876b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Creating volume ccebca28-48b8-4783-92c5-44c11636de1e {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:36:58 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:58 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Deleted volume successfully.
Apr 20 17:36:58 devstack sudo[89432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e 1073741824
Apr 20 17:36:58 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-74105c7b-568a-4383-85c0-19e06e0651d6 tempest-VolumesTransfersTest-1804537856 None] Lock "cinder-f027c762-8f4b-4a1b-a178-9bdbd91b0f05-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:36:58 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e 1073741824" returned: 0 in 0.476s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:36:58 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e
Apr 20 17:36:58 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:36:59 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 20 17:36:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e" returned: 0 in 0.451s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:36:59 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:36:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:36:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254ea09c-2c6a-43a1-8b34-7aba0ededf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccebca28-48b8-4783-92c5-44c11636de1e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c656da48-67d7-437d-bd56-decc075e4ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:36:59 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Volume volume-ccebca28-48b8-4783-92c5-44c11636de1e (ccebca28-48b8-4783-92c5-44c11636de1e): created successfully
Apr 20 17:36:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c656da48-67d7-437d-bd56-decc075e4ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:36:59 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Flow 'volume_create_manager' (f21eb273-2d51-4ba9-99ba-dc334c9d1e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:36:59 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3f7e63af-d4ef-41ab-9bb5-2977ddfd323a tempest-VolumesTransfersTest-1708026462 None] Created volume successfully.
Apr 20 17:37:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Acquiring lock "cinder-ccebca28-48b8-4783-92c5-44c11636de1e-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Lock "cinder-ccebca28-48b8-4783-92c5-44c11636de1e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Acquiring lock "cinder-quobyte-ccebca28-48b8-4783-92c5-44c11636de1e" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Lock "cinder-quobyte-ccebca28-48b8-4783-92c5-44c11636de1e" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:00 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d48269-afbc-40db-a5d2-6cca64d873d0]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:37:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:00 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e
Apr 20 17:37:00 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:01 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e" returned: 0 in 0.462s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:01 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e
Apr 20 17:37:01 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:01 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ccebca28-48b8-4783-92c5-44c11636de1e" returned: 0 in 0.407s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Lock "cinder-quobyte-ccebca28-48b8-4783-92c5-44c11636de1e" released by "delete_volume" :: held 0.896s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Created reservations ['2cfee481-962f-43e9-856f-b5bccea06e9b', '20d57a1d-d815-4610-9222-e08cff80b863', 'ecd6c69e-ba24-4450-a73e-485018709a3f', '6f7b1827-0acc-45b3-86fd-1083781c0504'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:01 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:37:01 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:02 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.469s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:02 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:37:02 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Deleted volume successfully.
Apr 20 17:37:02 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c6901d73-6509-49a1-a0d1-9c5a50e4c669 tempest-VolumesTransfersTest-1804537856 None] Lock "cinder-ccebca28-48b8-4783-92c5-44c11636de1e-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Flow 'volume_create_manager' (704c4c6d-14f9-428f-8e96-94bcf28a9e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4ece5c-87fb-406d-aed4-c8042567fecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4ece5c-87fb-406d-aed4-c8042567fecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1025413425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347d8e4eb5e94b1cb7cd463564d80999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:37:06Z,use_quota=True,user_id='1ca13de1d860483e9d62fbfc5d911a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33aa24e1-48ac-4263-86a4-9bf13656de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33aa24e1-48ac-4263-86a4-9bf13656de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a71a7e-0313-43e7-817f-637b89d14ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a71a7e-0313-43e7-817f-637b89d14ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1', 'volume_name': 'volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b889eb-ec35-41c0-9ca4-5a1822e01bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b889eb-ec35-41c0-9ca4-5a1822e01bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c31a91-3445-4170-9791-98c594382aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:05 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Volume d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1', 'volume_size': 1}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1025413425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347d8e4eb5e94b1cb7cd463564d80999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:37:06Z,use_quota=True,user_id='1ca13de1d860483e9d62fbfc5d911a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Creating volume d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:37:05 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:37:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:05 devstack sudo[89486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1 1073741824
Apr 20 17:37:05 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:06 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1 1073741824" returned: 0 in 0.457s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:06 devstack sudo[89492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1
Apr 20 17:37:06 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:06 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1" returned: 0 in 0.400s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:37:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57c31a91-3445-4170-9791-98c594382aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb08c15c-d224-4be5-8abc-c0c0814e0617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:06 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Volume volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1 (d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1): created successfully
Apr 20 17:37:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb08c15c-d224-4be5-8abc-c0c0814e0617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Flow 'volume_create_manager' (704c4c6d-14f9-428f-8e96-94bcf28a9e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:37:06 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-2de1aea2-9671-4f6c-bdc0-f3ea2e4b40e3 tempest-VolumesTransfersV355Test-1931716747 None] Created volume successfully.
Apr 20 17:37:07 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-1d460add-4032-46a1-bc86-a573b24b94b5 tempest-VolumesTransfersV355Test-2001668313 None] Transfer volume completed successfully.
Apr 20 17:37:07 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Acquiring lock "cinder-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:07 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Lock "cinder-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:07 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Acquiring lock "cinder-quobyte-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:07 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Lock "cinder-quobyte-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:07 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeffce0-2db3-4c9f-9115-3547d8dbe2be]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:37:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:07 devstack sudo[89495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1
Apr 20 17:37:07 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:08 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1" returned: 0 in 0.452s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:08 devstack sudo[89500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1
Apr 20 17:37:08 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:08 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1" returned: 0 in 0.398s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Lock "cinder-quobyte-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1" released by "delete_volume" :: held 0.878s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Created reservations ['5c537444-da35-477f-9c30-466282cc8e25', '04c11d2c-3e9e-45ff-8dd0-c6948d8a663f', 'fe98a790-998d-4eb2-b09c-500cb048453a', '222a5a98-a878-4058-9c12-21b4a1d39b89'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:08 devstack sudo[89503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:37:08 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Flow 'volume_create_manager' (c379b596-012f-4e8e-99aa-ec6bcede696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2634af-76ca-419f-b007-862e1cef61a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2634af-76ca-419f-b007-862e1cef61a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1055530345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a424afcb-cc4d-460c-992d-81113c03a0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347d8e4eb5e94b1cb7cd463564d80999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:37:09Z,use_quota=True,user_id='1ca13de1d860483e9d62fbfc5d911a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced37b28-3fc1-4558-a857-8419e662c055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced37b28-3fc1-4558-a857-8419e662c055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f343e8f-ccb3-4daa-9954-a366bd0a2608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f343e8f-ccb3-4daa-9954-a366bd0a2608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a424afcb-cc4d-460c-992d-81113c03a0a6', 'volume_name': 'volume-a424afcb-cc4d-460c-992d-81113c03a0a6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b09df6-34d7-4a0d-bf20-49d1b577fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b09df6-34d7-4a0d-bf20-49d1b577fc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14dcc5a4-3802-4cb1-b677-143956ca7cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:09 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Volume a424afcb-cc4d-460c-992d-81113c03a0a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a424afcb-cc4d-460c-992d-81113c03a0a6', 'volume_size': 1}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1055530345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a424afcb-cc4d-460c-992d-81113c03a0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='347d8e4eb5e94b1cb7cd463564d80999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:37:09Z,use_quota=True,user_id='1ca13de1d860483e9d62fbfc5d911a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Creating volume a424afcb-cc4d-460c-992d-81113c03a0a6 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:37:09 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:09 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.455s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:37:09 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6 1073741824
Apr 20 17:37:09 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:09 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Deleted volume successfully.
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c4d0d086-34f8-4e5c-90f7-848bf8e7f93d tempest-VolumesTransfersV355Test-1539122652 None] Lock "cinder-d0cb1ad8-44e4-48d9-9ebc-f58aa7530cd1-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:37:09 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6 1073741824" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:09 devstack sudo[89511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6
Apr 20 17:37:09 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:10 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6" returned: 0 in 0.393s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14dcc5a4-3802-4cb1-b677-143956ca7cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a424afcb-cc4d-460c-992d-81113c03a0a6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53feb9bf-b0c7-458c-bac5-11e658a1d83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:10 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Volume volume-a424afcb-cc4d-460c-992d-81113c03a0a6 (a424afcb-cc4d-460c-992d-81113c03a0a6): created successfully
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53feb9bf-b0c7-458c-bac5-11e658a1d83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Flow 'volume_create_manager' (c379b596-012f-4e8e-99aa-ec6bcede696d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:37:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-162164a4-f03e-4277-9025-cbca9c38efcc tempest-VolumesTransfersV355Test-1931716747 None] Created volume successfully.
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Acquiring lock "cinder-a424afcb-cc4d-460c-992d-81113c03a0a6-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Lock "cinder-a424afcb-cc4d-460c-992d-81113c03a0a6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Acquiring lock "cinder-quobyte-a424afcb-cc4d-460c-992d-81113c03a0a6" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Lock "cinder-quobyte-a424afcb-cc4d-460c-992d-81113c03a0a6" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b8ff30-78cf-4c4d-a400-f5192a0f3db3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:10 devstack sudo[89514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6
Apr 20 17:37:10 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:10 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6" returned: 0 in 0.449s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:11 devstack sudo[89519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6
Apr 20 17:37:11 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:11 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-a424afcb-cc4d-460c-992d-81113c03a0a6" returned: 0 in 0.401s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Lock "cinder-quobyte-a424afcb-cc4d-460c-992d-81113c03a0a6" released by "delete_volume" :: held 0.870s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Created reservations ['0052bf68-5196-467d-a0fb-d62544ee7f4a', 'cc360394-eabf-4f76-b009-881ec789e00d', '84503126-7652-4c52-a77d-fb3030f853db', 'f8361fb3-8e3a-4071-8a9a-dc9ac3a36aaa'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:11 devstack sudo[89522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:37:11 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:11 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.486s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:37:11 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Deleted volume successfully.
Apr 20 17:37:11 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-2e34cca5-c1d2-4cc4-b6b4-81c6d8e17727 tempest-VolumesTransfersV355Test-1539122652 None] Lock "cinder-a424afcb-cc4d-460c-992d-81113c03a0a6-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Flow 'volume_create_manager' (77f5f63f-738b-446d-ac5f-9b9684e25cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8de2b8-5e03-43b6-94db-42303720bd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8de2b8-5e03-43b6-94db-42303720bd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1588254089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9547a5-c5e7-4037-bb47-0c7465c6a3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760801dd6e3f4b0a829377ea525ac1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:37:20Z,use_quota=True,user_id='e05321693a844a5696f6f01c722f8df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fc69cd-97bc-48ae-b00e-9907cbac8633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fc69cd-97bc-48ae-b00e-9907cbac8633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58fc9b4-8753-4e43-ba03-3f57563db7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58fc9b4-8753-4e43-ba03-3f57563db7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9547a5-c5e7-4037-bb47-0c7465c6a3c7', 'volume_name': 'volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a167d7f-fed6-45a5-972f-38632252ee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a167d7f-fed6-45a5-972f-38632252ee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34882cbb-78cd-4a6a-a203-eed2686549a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:20 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Volume 7d9547a5-c5e7-4037-bb47-0c7465c6a3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7', 'volume_size': 1}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1588254089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9547a5-c5e7-4037-bb47-0c7465c6a3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760801dd6e3f4b0a829377ea525ac1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:37:20Z,use_quota=True,user_id='e05321693a844a5696f6f01c722f8df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Creating volume 7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:37:20 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:20 devstack sudo[89528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 1073741824
Apr 20 17:37:20 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:20 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 1073741824" returned: 0 in 0.448s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:20 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7
Apr 20 17:37:20 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:21 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" returned: 0 in 0.389s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:21 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:37:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34882cbb-78cd-4a6a-a203-eed2686549a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f690b5fe-3bd9-4d52-a3ce-40d779aff3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:37:21 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Volume volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 (7d9547a5-c5e7-4037-bb47-0c7465c6a3c7): created successfully
Apr 20 17:37:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f690b5fe-3bd9-4d52-a3ce-40d779aff3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:37:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Flow 'volume_create_manager' (77f5f63f-738b-446d-ac5f-9b9684e25cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:37:21 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-67817419-92bd-4c34-a5bf-d7a28f4b283c tempest-VolumesActionsTest-1197398454 None] Created volume successfully.
Apr 20 17:37:31 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=34,cinder:UPDATE=55,cinder:INSERT=13,cinder:DELETE=4 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:37:31 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:INSERT=8,cinder:UPDATE=39,cinder:DELETE=5,cinder:SELECT=28 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:37:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7cd1eb01-abdf-4d7b-b570-87e044105948 tempest-VolumesActionsTest-1197398454 None] Acquiring lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" by "attach_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7cd1eb01-abdf-4d7b-b570-87e044105948 tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" acquired by "attach_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:34 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7cd1eb01-abdf-4d7b-b570-87e044105948 tempest-VolumesActionsTest-1197398454 None] Attaching volume 7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 to instance ecb3ef46-52e0-443b-8399-face814ae7db at mountpoint /dev/vdb on host None.
Apr 20 17:37:34 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7cd1eb01-abdf-4d7b-b570-87e044105948 tempest-VolumesActionsTest-1197398454 None] Attach volume completed successfully.
Apr 20 17:37:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7cd1eb01-abdf-4d7b-b570-87e044105948 tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" released by "attach_volume" :: held 0.070s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:37:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e0dd5509-61a4-4429-822a-ae4714d2cfe0 tempest-VolumesActionsTest-1197398454 None] Acquiring lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7-detach_volume" by "detach_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e0dd5509-61a4-4429-822a-ae4714d2cfe0 tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e0dd5509-61a4-4429-822a-ae4714d2cfe0 tempest-VolumesActionsTest-1197398454 None] Detaching volume 7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 from instance ecb3ef46-52e0-443b-8399-face814ae7db.
Apr 20 17:37:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e0dd5509-61a4-4429-822a-ae4714d2cfe0 tempest-VolumesActionsTest-1197398454 None] Detach volume completed successfully.
Apr 20 17:37:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e0dd5509-61a4-4429-822a-ae4714d2cfe0 tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:37:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:37:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:37:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:37:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:37:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:37:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:37:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:37:43 devstack sudo[89624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:37:43 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:37:43 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root
Apr 20 17:37:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.427s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:37:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:37:45 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:INSERT=2,cinder:SELECT=4,cinder:UPDATE=4 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:37:45 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:37:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0561f6c9-0883-4946-a27b-a59f326c418a tempest-VolumesActionsTest-1197398454 None] Acquiring lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" by "attach_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0561f6c9-0883-4946-a27b-a59f326c418a tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" acquired by "attach_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0561f6c9-0883-4946-a27b-a59f326c418a tempest-VolumesActionsTest-1197398454 None] Attaching volume 7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 to instance 6f29c706-4f3f-4c6a-b91c-e18543c8094b at mountpoint /dev/vdb on host None.
Apr 20 17:37:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0561f6c9-0883-4946-a27b-a59f326c418a tempest-VolumesActionsTest-1197398454 None] Attach volume completed successfully.
Apr 20 17:37:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0561f6c9-0883-4946-a27b-a59f326c418a tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" released by "attach_volume" :: held 0.058s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:37:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6f74943c-1b85-43df-84fd-d8c337d8ce7d tempest-VolumesActionsTest-1197398454 None] Acquiring lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7-detach_volume" by "detach_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:37:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6f74943c-1b85-43df-84fd-d8c337d8ce7d tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:37:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6f74943c-1b85-43df-84fd-d8c337d8ce7d tempest-VolumesActionsTest-1197398454 None] Detaching volume 7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 from instance 6f29c706-4f3f-4c6a-b91c-e18543c8094b.
Apr 20 17:37:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6f74943c-1b85-43df-84fd-d8c337d8ce7d tempest-VolumesActionsTest-1197398454 None] Detach volume completed successfully.
Apr 20 17:37:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6f74943c-1b85-43df-84fd-d8c337d8ce7d tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:05 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c90a4ad-0557-490a-b5eb-50a8ae03078c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:05 devstack sudo[89748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7
Apr 20 17:38:05 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:05 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" returned: 0 in 0.468s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:05 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a62b600-04fb-40af-b8ee-82bcf54b0edb]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:05 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7
Apr 20 17:38:05 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:06 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" returned: 0 in 0.456s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.383c1e7f-3c8a-4fa9-a840-5da2d8cf221ejmc0u0uh.img {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:06 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.383c1e7f-3c8a-4fa9-a840-5da2d8cf221ejmc0u0uh.img
Apr 20 17:38:06 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:06 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:38:07 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.383c1e7f-3c8a-4fa9-a840-5da2d8cf221ejmc0u0uh.img" returned: 0 in 1.783s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:07 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77adbac-70b4-4973-accb-74185fcb0b25]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:07 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7
Apr 20 17:38:07 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:08 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" returned: 0 in 0.576s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:08 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7, size 1024.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.383c1e7f-3c8a-4fa9-a840-5da2d8cf221ejmc0u0uh.img {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:38:08 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Converted 1024.00 MB image at 573.97 MB/s
Apr 20 17:38:08 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] 383c1e7f-3c8a-4fa9-a840-5da2d8cf221e was raw, no need to convert to raw {{(pid=82690) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 20 17:38:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.676s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Uploaded volume to glance image-id: 383c1e7f-3c8a-4fa9-a840-5da2d8cf221e. {{(pid=82690) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 20 17:38:17 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-245ad291-c414-4aef-bfe6-7911a136860f tempest-VolumesActionsTest-1197398454 None] Copy volume to image completed successfully.
Apr 20 17:38:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:19 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb25fc32-363a-41dc-9d90-7e8a207ac717]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:19 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7
Apr 20 17:38:19 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:19 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" returned: 0 in 0.458s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:19 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc148bb-06bf-4922-a1ae-02d15f513367]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:19 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7
Apr 20 17:38:19 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:19 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" returned: 0 in 0.461s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:19 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img
Apr 20 17:38:19 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:21 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img" returned: 0 in 1.743s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:21 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d48f78-c033-4c8b-a2dc-6c7ec1e6c1bd]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:21 devstack sudo[89800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7
Apr 20 17:38:21 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:22 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" returned: 0 in 0.570s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:22 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7, size 1024.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:38:22 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Converted 1024.00 MB image at 587.08 MB/s
Apr 20 17:38:22 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] a4b2198d-a429-442f-a85a-b4ea2bd89f10 was raw, converting to qcow2 {{(pid=82690) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 20 17:38:22 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0063eaa-f10f-47c7-af80-cad65e07b7ea]: (4, 'raw') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:22 devstack sudo[89805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img
Apr 20 17:38:22 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:22 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img" returned: 0 in 0.449s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:22 devstack sudo[89809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img
Apr 20 17:38:22 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:23 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img" returned: 1 in 0.476s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img' failed. Not Retrying. {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 20 17:38:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img /opt/stack/data/cinder/conversion/vol_upload_3o7v0yf8 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:23 devstack sudo[89814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img /opt/stack/data/cinder/conversion/vol_upload_3o7v0yf8
Apr 20 17:38:23 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:23 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img /opt/stack/data/cinder/conversion/vol_upload_3o7v0yf8" returned: 0 in 0.580s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:23 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Image conversion details: src /opt/stack/data/cinder/conversion/7d9547a5-c5e7-4037-bb47-0c7465c6a3c7.temp_image.a4b2198d-a429-442f-a85a-b4ea2bd89f10mrqxemny.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3o7v0yf8 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:38:23 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 20 17:38:23 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc257fd-7707-4cad-8295-c83110757829]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3o7v0yf8 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:23 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3o7v0yf8
Apr 20 17:38:23 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:24 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3o7v0yf8" returned: 0 in 0.447s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 5.981s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Uploaded volume to glance image-id: a4b2198d-a429-442f-a85a-b4ea2bd89f10. {{(pid=82690) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 20 17:38:25 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-76ea90d0-2c15-4e9d-a103-9f58a8884151 tempest-VolumesActionsTest-1197398454 None] Copy volume to image completed successfully.
Apr 20 17:38:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Acquiring lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Acquiring lock "cinder-quobyte-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:25 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Lock "cinder-quobyte-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:25 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2fccd-4720-4510-a9c8-a2dd8f14d8db]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:25 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7
Apr 20 17:38:25 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:26 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" returned: 0 in 0.451s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:26 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7
Apr 20 17:38:26 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:26 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" returned: 0 in 0.398s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Lock "cinder-quobyte-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7" released by "delete_volume" :: held 0.877s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Created reservations ['92127198-1b78-4ac4-9e60-c5a687debb92', '4df896e4-fd5a-425b-9181-0be51222f933', 'a26252b1-2a27-4db6-b7cb-72119e521606', 'e55d24cc-bef2-4d35-a443-b3530ec64a09'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:26 devstack sudo[89833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:26 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:27 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.415s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:27 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:27 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Deleted volume successfully.
Apr 20 17:38:27 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-207d7db9-b36c-41e3-96ce-6d838c8da15b tempest-VolumesActionsTest-1197398454 None] Lock "cinder-7d9547a5-c5e7-4037-bb47-0c7465c6a3c7-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (1dc73d76-feda-47f7-b5b3-c89e8166d85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3f66c9-9b08-4ca2-887a-279e98748c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3f66c9-9b08-4ca2-887a-279e98748c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1709920895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d9c266-b168-436a-83a6-f49da35c9b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:31Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b81f25e-fcff-408e-9b77-51b3ea784a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b81f25e-fcff-408e-9b77-51b3ea784a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd90a82f-93ab-4d18-9415-be03988a448e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd90a82f-93ab-4d18-9415-be03988a448e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4d9c266-b168-436a-83a6-f49da35c9b71', 'volume_name': 'volume-d4d9c266-b168-436a-83a6-f49da35c9b71', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c168f5a3-269a-4487-b43d-9b684c425a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c168f5a3-269a-4487-b43d-9b684c425a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c7f0bb-8fb3-494e-980a-bde4ede2b21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Volume d4d9c266-b168-436a-83a6-f49da35c9b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4d9c266-b168-436a-83a6-f49da35c9b71', 'volume_size': 1}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1709920895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4d9c266-b168-436a-83a6-f49da35c9b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:31Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Creating volume d4d9c266-b168-436a-83a6-f49da35c9b71 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:31 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:31 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71 1073741824
Apr 20 17:38:31 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (a4ec7f6f-0365-4706-8d26-8dde0c7589b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80158a6c-f8af-4343-b8ab-b0f86d7e8ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80158a6c-f8af-4343-b8ab-b0f86d7e8ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641854804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938c4ca6-95b4-433a-8337-90c276a64dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:32Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97feca76-7d02-474b-97fb-bb903eaf142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97feca76-7d02-474b-97fb-bb903eaf142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ca0348-cdc4-4fb5-84b0-80f14b788f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ca0348-cdc4-4fb5-84b0-80f14b788f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938c4ca6-95b4-433a-8337-90c276a64dcb', 'volume_name': 'volume-938c4ca6-95b4-433a-8337-90c276a64dcb', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb2339d-12da-4a53-9934-9c9ba8967f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb2339d-12da-4a53-9934-9c9ba8967f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad688684-1785-4b72-a83b-c9047aa198f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Volume 938c4ca6-95b4-433a-8337-90c276a64dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938c4ca6-95b4-433a-8337-90c276a64dcb', 'volume_size': 1}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (8a0ec3f1-0b2d-4fdc-8671-f5de83bf0e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece84277-849f-4bd8-8e99-d9a213db962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece84277-849f-4bd8-8e99-d9a213db962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-923924796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1330bc4-5c1d-43bf-80f2-448b9ae837ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:32Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaf1ad2-ac86-4bf8-a17d-059a9543b5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaf1ad2-ac86-4bf8-a17d-059a9543b5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eee8ad1-dc8a-4659-b17e-4f90bcb4b579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eee8ad1-dc8a-4659-b17e-4f90bcb4b579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1330bc4-5c1d-43bf-80f2-448b9ae837ec', 'volume_name': 'volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9c2a3e-9d1e-4e8e-89a7-46dcb635b921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e9c2a3e-9d1e-4e8e-89a7-46dcb635b921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02edcb1-4183-458d-8dcf-2b75e9d63de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Volume e1330bc4-5c1d-43bf-80f2-448b9ae837ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec', 'volume_size': 1}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (dfbae858-13a2-437f-a62b-0b6df62fbd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d191f9-a4f2-42b7-a12e-4c085f317a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d191f9-a4f2-42b7-a12e-4c085f317a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-441530870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869e73a1-e9e2-4d7e-8cca-9d662ba0da94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:32Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcb7e6f-4485-44d7-a90a-4bfc34d6bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcb7e6f-4485-44d7-a90a-4bfc34d6bd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cd523a-ce2b-4a48-8f24-b7c45822da55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cd523a-ce2b-4a48-8f24-b7c45822da55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869e73a1-e9e2-4d7e-8cca-9d662ba0da94', 'volume_name': 'volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0c768b-281e-46bc-aa4c-290a91faf999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0c768b-281e-46bc-aa4c-290a91faf999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0334ca-375d-4200-b868-c0a5e8f76759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:31 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Volume 869e73a1-e9e2-4d7e-8cca-9d662ba0da94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94', 'volume_size': 1}
Apr 20 17:38:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:32 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71 1073741824" returned: 0 in 0.576s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:32 devstack sudo[89844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71
Apr 20 17:38:32 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (46d23dc2-4e95-478d-9c9f-82c2dde1053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd3e9c6-6a12-4c98-9be9-022f7f7fe2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd3e9c6-6a12-4c98-9be9-022f7f7fe2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1818893023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e686f8bc-7da9-4551-b3fc-55cbe64082bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:32Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721d670a-2764-4bd3-944f-d1eb37506d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721d670a-2764-4bd3-944f-d1eb37506d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeff399-f87e-4780-abe8-a3e9b7293c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeff399-f87e-4780-abe8-a3e9b7293c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e686f8bc-7da9-4551-b3fc-55cbe64082bb', 'volume_name': 'volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a3aa98-8848-429f-9898-a2c24d563ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a3aa98-8848-429f-9898-a2c24d563ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2e7368-8923-416b-8b84-2e697be9eea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:32 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Volume e686f8bc-7da9-4551-b3fc-55cbe64082bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb', 'volume_size': 1}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:32 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71" returned: 0 in 0.407s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1641854804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938c4ca6-95b4-433a-8337-90c276a64dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:32Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Creating volume 938c4ca6-95b4-433a-8337-90c276a64dcb {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:32 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c7f0bb-8fb3-494e-980a-bde4ede2b21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4d9c266-b168-436a-83a6-f49da35c9b71', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc6f5da-c30d-4a65-aa75-17ef37e82a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:32 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb 1073741824
Apr 20 17:38:32 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:32 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Volume volume-d4d9c266-b168-436a-83a6-f49da35c9b71 (d4d9c266-b168-436a-83a6-f49da35c9b71): created successfully
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc6f5da-c30d-4a65-aa75-17ef37e82a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (1dc73d76-feda-47f7-b5b3-c89e8166d85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:32 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-bbe08ebc-0fff-48eb-8e69-38700c2a6850 tempest-CreateVolumesFromImageTest-837405678 None] Created volume successfully.
Apr 20 17:38:32 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb 1073741824" returned: 0 in 0.479s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:32 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb
Apr 20 17:38:32 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:33 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb" returned: 0 in 0.417s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-923924796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1330bc4-5c1d-43bf-80f2-448b9ae837ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:32Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Creating volume e1330bc4-5c1d-43bf-80f2-448b9ae837ec {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:33 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad688684-1785-4b72-a83b-c9047aa198f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938c4ca6-95b4-433a-8337-90c276a64dcb', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2153d7d3-e24d-4608-a353-4e1e8940a7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:33 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec 1073741824
Apr 20 17:38:33 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:33 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Volume volume-938c4ca6-95b4-433a-8337-90c276a64dcb (938c4ca6-95b4-433a-8337-90c276a64dcb): created successfully
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2153d7d3-e24d-4608-a353-4e1e8940a7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (a4ec7f6f-0365-4706-8d26-8dde0c7589b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:33 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-65c04c14-e141-4c60-b733-8e3fd8f02532 tempest-CreateVolumesFromImageTest-837405678 None] Created volume successfully.
Apr 20 17:38:33 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec 1073741824" returned: 0 in 0.475s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:33 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec
Apr 20 17:38:33 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:34 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec" returned: 0 in 0.428s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.345s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-441530870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869e73a1-e9e2-4d7e-8cca-9d662ba0da94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:32Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Creating volume 869e73a1-e9e2-4d7e-8cca-9d662ba0da94 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:34 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02edcb1-4183-458d-8dcf-2b75e9d63de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873143b9-d488-485b-b798-e5d694e9eb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:34 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94 1073741824
Apr 20 17:38:34 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:34 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Volume volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec (e1330bc4-5c1d-43bf-80f2-448b9ae837ec): created successfully
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873143b9-d488-485b-b798-e5d694e9eb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (8a0ec3f1-0b2d-4fdc-8671-f5de83bf0e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:34 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-853a2a16-f122-4992-818a-688b0e74522f tempest-CreateVolumesFromImageTest-837405678 None] Created volume successfully.
Apr 20 17:38:34 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94 1073741824" returned: 0 in 0.461s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:34 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94
Apr 20 17:38:34 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:35 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94" returned: 0 in 0.401s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.057s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1818893023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e686f8bc-7da9-4551-b3fc-55cbe64082bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557b9a04a920439294b13580edb2bc97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:32Z,use_quota=True,user_id='5c5d86bc50a34f74a7257bd2a17494a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Creating volume e686f8bc-7da9-4551-b3fc-55cbe64082bb {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:35 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0334ca-375d-4200-b868-c0a5e8f76759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11430c3c-6749-4463-8e43-04c0209cfd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:35 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb 1073741824
Apr 20 17:38:35 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:35 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Volume volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94 (869e73a1-e9e2-4d7e-8cca-9d662ba0da94): created successfully
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11430c3c-6749-4463-8e43-04c0209cfd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (dfbae858-13a2-437f-a62b-0b6df62fbd3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ffc6d82f-a709-466d-a367-f3228907504b tempest-CreateVolumesFromImageTest-837405678 None] Created volume successfully.
Apr 20 17:38:35 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb 1073741824" returned: 0 in 0.485s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:35 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb
Apr 20 17:38:35 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:36 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb" returned: 0 in 0.399s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2e7368-8923-416b-8b84-2e697be9eea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53cc430-9061-422a-bd33-4aef53ecaf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:36 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Volume volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb (e686f8bc-7da9-4551-b3fc-55cbe64082bb): created successfully
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53cc430-9061-422a-bd33-4aef53ecaf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Flow 'volume_create_manager' (46d23dc2-4e95-478d-9c9f-82c2dde1053d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:36 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7e45b451-a07b-4b22-94ce-350a6095815e tempest-CreateVolumesFromImageTest-837405678 None] Created volume successfully.
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-e686f8bc-7da9-4551-b3fc-55cbe64082bb-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-e686f8bc-7da9-4551-b3fc-55cbe64082bb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-quobyte-e686f8bc-7da9-4551-b3fc-55cbe64082bb" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-e686f8bc-7da9-4551-b3fc-55cbe64082bb" acquired by "delete_volume" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e71324b-51e8-490b-bcef-43cb303aef89]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:36 devstack sudo[89880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb
Apr 20 17:38:36 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:36 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb" returned: 0 in 0.451s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:37 devstack sudo[89885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb
Apr 20 17:38:37 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:37 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e686f8bc-7da9-4551-b3fc-55cbe64082bb" returned: 0 in 0.402s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-e686f8bc-7da9-4551-b3fc-55cbe64082bb" released by "delete_volume" :: held 0.873s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Created reservations ['3d686c14-a01c-46a1-a2c4-82acc0977ddd', '81acdc9b-1a9d-4aff-8a62-7ab300d75f86', 'ea14ed0e-0c3a-489f-b6ab-b5094cd40628', '396cbc7e-20ca-4ead-87f3-3d07c0a22e9d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:37 devstack sudo[89888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:37 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-869e73a1-e9e2-4d7e-8cca-9d662ba0da94-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-869e73a1-e9e2-4d7e-8cca-9d662ba0da94-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-quobyte-869e73a1-e9e2-4d7e-8cca-9d662ba0da94" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-869e73a1-e9e2-4d7e-8cca-9d662ba0da94" acquired by "delete_volume" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e295eeb9-83f1-47f8-bfc3-0c09b296267d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:37 devstack sudo[89890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94
Apr 20 17:38:37 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:37 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.427s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Deleted volume successfully.
Apr 20 17:38:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-5d0f53a9-151b-462b-9f79-d0321f56e526 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-e686f8bc-7da9-4551-b3fc-55cbe64082bb-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:38 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94" returned: 0 in 0.457s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:38 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94
Apr 20 17:38:38 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:38 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-869e73a1-e9e2-4d7e-8cca-9d662ba0da94" returned: 0 in 0.391s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-869e73a1-e9e2-4d7e-8cca-9d662ba0da94" released by "delete_volume" :: held 0.878s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Created reservations ['bd8bbf83-96de-437b-a2f8-f678536b0e73', '28ea701c-f726-4242-b942-d9b92952b6dd', '58b44997-5a36-4479-b415-68d6ff0495e2', '6a5c45ad-6c6b-47d6-ab5a-f98e02fe2017'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:38 devstack sudo[89899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:38 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-e1330bc4-5c1d-43bf-80f2-448b9ae837ec-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-e1330bc4-5c1d-43bf-80f2-448b9ae837ec-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-quobyte-e1330bc4-5c1d-43bf-80f2-448b9ae837ec" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-e1330bc4-5c1d-43bf-80f2-448b9ae837ec" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[99689405-0de0-49e5-8d59-e5eebf10fddb]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:38 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec
Apr 20 17:38:38 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:39 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.431s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:39 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Deleted volume successfully.
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ab02257-f8b8-4c92-8540-4ed296c29ac9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-869e73a1-e9e2-4d7e-8cca-9d662ba0da94-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:39 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec" returned: 0 in 0.476s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:39 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec
Apr 20 17:38:39 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:39 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-e1330bc4-5c1d-43bf-80f2-448b9ae837ec" returned: 0 in 0.406s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-e1330bc4-5c1d-43bf-80f2-448b9ae837ec" released by "delete_volume" :: held 0.911s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Created reservations ['6e30dffe-dd42-4cbf-b7cf-6a75454ebcf4', '0d7dd9f4-d2ed-4a9b-93f8-22dc1324c37b', 'cf346460-c528-42c5-beca-deb6df625bde', '18326e5d-ac1c-49db-8258-c1516456b749'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:39 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:39 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-938c4ca6-95b4-433a-8337-90c276a64dcb-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-938c4ca6-95b4-433a-8337-90c276a64dcb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-quobyte-938c4ca6-95b4-433a-8337-90c276a64dcb" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-938c4ca6-95b4-433a-8337-90c276a64dcb" acquired by "delete_volume" :: waited 0.017s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e674ca9-4475-4e3e-b3d9-f24ea3afe9d9]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:39 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb
Apr 20 17:38:39 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:40 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.427s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:40 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Deleted volume successfully.
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-91aa0ae3-81fe-4d68-b753-314cd9a12942 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-e1330bc4-5c1d-43bf-80f2-448b9ae837ec-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:40 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb" returned: 0 in 0.488s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:40 devstack sudo[89918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb
Apr 20 17:38:40 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:40 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-938c4ca6-95b4-433a-8337-90c276a64dcb" returned: 0 in 0.423s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-938c4ca6-95b4-433a-8337-90c276a64dcb" released by "delete_volume" :: held 0.930s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Created reservations ['5480fc8b-c9d9-4645-ad2c-0f63e14bb756', '330430bd-dd16-4211-8412-55daf267a5af', 'b2e81161-e32c-4293-b6b2-2a815eea5a92', '7fe8f60e-76e0-4319-bdfd-28bda06b8e28'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:40 devstack sudo[89921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:40 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-d4d9c266-b168-436a-83a6-f49da35c9b71-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-d4d9c266-b168-436a-83a6-f49da35c9b71-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "cinder-quobyte-d4d9c266-b168-436a-83a6-f49da35c9b71" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-d4d9c266-b168-436a-83a6-f49da35c9b71" acquired by "delete_volume" :: waited 0.018s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb030405-9868-4467-981b-0f07338ced89]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:41 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71
Apr 20 17:38:41 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:41 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.415s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:41 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Deleted volume successfully.
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d7b90489-9f81-4af7-9695-f24d6b594ff9 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-938c4ca6-95b4-433a-8337-90c276a64dcb-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:41 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71" returned: 0 in 0.484s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:41 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71
Apr 20 17:38:41 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:41 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4d9c266-b168-436a-83a6-f49da35c9b71" returned: 0 in 0.396s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-quobyte-d4d9c266-b168-436a-83a6-f49da35c9b71" released by "delete_volume" :: held 0.898s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Created reservations ['3c28c9a6-f389-45fa-88c4-033cb3359084', '05401ff8-b531-4ffc-a908-de56321d3500', 'e758d563-03b5-4582-8101-5994b379b15a', '7d0e0c07-5dda-4a1b-af86-e8aecb4e9a39'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:41 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:41 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:42 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.472s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:42 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:42 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Deleted volume successfully.
Apr 20 17:38:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-eb507c2b-c58d-4f2b-8e7e-8d66e4bb1026 tempest-CreateVolumesFromImageTest-837405678 None] Lock "cinder-d4d9c266-b168-436a-83a6-f49da35c9b71-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:43 devstack sudo[89937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:43 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:43 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.469s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (bb280b22-da10-46ce-ad64-06521ee400a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2955ac-971c-40d1-acb1-f93e7fc121af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2955ac-971c-40d1-acb1-f93e7fc121af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907362710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b488bbb7-9584-4bbf-ab34-35c030917550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:44Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f5a7f9-61e4-4c0b-8125-aa5b468e381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f5a7f9-61e4-4c0b-8125-aa5b468e381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e79432-08c9-46a5-b453-1ff41b558c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84e79432-08c9-46a5-b453-1ff41b558c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b488bbb7-9584-4bbf-ab34-35c030917550', 'volume_name': 'volume-b488bbb7-9584-4bbf-ab34-35c030917550', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f71ada-1c34-4095-9ac4-625727baed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f71ada-1c34-4095-9ac4-625727baed47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15323ed9-e90a-46f1-9440-c76a7dbb61fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:43 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume b488bbb7-9584-4bbf-ab34-35c030917550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b488bbb7-9584-4bbf-ab34-35c030917550', 'volume_size': 1}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907362710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b488bbb7-9584-4bbf-ab34-35c030917550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:44Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Creating volume b488bbb7-9584-4bbf-ab34-35c030917550 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:43 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:43 devstack sudo[89940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550 1073741824
Apr 20 17:38:43 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:44 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550 1073741824" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:44 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550
Apr 20 17:38:44 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:44 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550" returned: 0 in 0.401s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:44 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15323ed9-e90a-46f1-9440-c76a7dbb61fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b488bbb7-9584-4bbf-ab34-35c030917550', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:44 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5841c3f2-9b8f-44ec-aa36-20314ae5621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:44 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume volume-b488bbb7-9584-4bbf-ab34-35c030917550 (b488bbb7-9584-4bbf-ab34-35c030917550): created successfully
Apr 20 17:38:44 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5841c3f2-9b8f-44ec-aa36-20314ae5621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:44 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (bb280b22-da10-46ce-ad64-06521ee400a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:44 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-73a813b6-232b-4681-937a-76376866c649 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created volume successfully.
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (f51eccb3-a2fe-4642-8755-ef3fba881325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4fffa9-9f1e-41d5-af9f-f45257c0114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4fffa9-9f1e-41d5-af9f-f45257c0114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520791754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:46Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c088478b-f785-4ce8-806b-648f14e08b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c088478b-f785-4ce8-806b-648f14e08b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e42f31e-397f-47fa-baf0-c0fd5b99bc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e42f31e-397f-47fa-baf0-c0fd5b99bc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35', 'volume_name': 'volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9cdf39-0172-4e49-8c1d-59fe43171b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9cdf39-0172-4e49-8c1d-59fe43171b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d94fbe4-31d9-4134-a0bc-6577d7d9f07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume 4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35', 'volume_size': 1}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520791754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:46Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Creating volume 4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:46 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:46 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35 1073741824
Apr 20 17:38:46 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (5395008c-a9f2-4bb7-bb0f-5607615535d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df628523-ed6f-4887-b969-d9bb097989bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df628523-ed6f-4887-b969-d9bb097989bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-385315008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d209c3ad-2002-406a-86e9-32eeddd68939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:46Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbabab9d-76d6-4085-a9f6-06e2fcfb216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbabab9d-76d6-4085-a9f6-06e2fcfb216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ba69f6-b36c-4949-9d21-f14331138207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ba69f6-b36c-4949-9d21-f14331138207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd209c3ad-2002-406a-86e9-32eeddd68939', 'volume_name': 'volume-d209c3ad-2002-406a-86e9-32eeddd68939', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59a9eff-1dbf-4d73-a62a-4523380bd811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59a9eff-1dbf-4d73-a62a-4523380bd811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b293000f-2ba9-44ab-baff-ca7597c87520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume d209c3ad-2002-406a-86e9-32eeddd68939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d209c3ad-2002-406a-86e9-32eeddd68939', 'volume_size': 1}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (9d931a38-8382-4987-ac00-6fa9af02ffb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043876c7-3f55-4efa-ad90-268684e42c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043876c7-3f55-4efa-ad90-268684e42c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694830218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d3c071-9c76-4bc4-bfc7-3e9108c92523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:46Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4cc491-a61f-44ae-b485-8a9df4c77bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4cc491-a61f-44ae-b485-8a9df4c77bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a13c737-c744-460f-a4dc-c12ea8b69fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a13c737-c744-460f-a4dc-c12ea8b69fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d3c071-9c76-4bc4-bfc7-3e9108c92523', 'volume_name': 'volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd0ce26-edee-4336-92f7-77c714098d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd0ce26-edee-4336-92f7-77c714098d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79eca12b-d4e4-4b32-9225-8018e9996e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume 72d3c071-9c76-4bc4-bfc7-3e9108c92523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523', 'volume_size': 1}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:46 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35 1073741824" returned: 0 in 0.516s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:46 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35
Apr 20 17:38:46 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (ba6e5a4b-3452-4f13-b4ca-e20dd14d6aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99c2806-d0eb-4be8-81f2-5ecc8bf92724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99c2806-d0eb-4be8-81f2-5ecc8bf92724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440613204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83304052-5600-4d83-be3c-d7a574d40768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:47Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0813eb-2f89-4f0d-af2c-b45b89fa5413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0813eb-2f89-4f0d-af2c-b45b89fa5413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48023d64-3aba-417b-8a09-d178e257b4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48023d64-3aba-417b-8a09-d178e257b4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83304052-5600-4d83-be3c-d7a574d40768', 'volume_name': 'volume-83304052-5600-4d83-be3c-d7a574d40768', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc78946e-700c-4306-8f7d-1b4d696124eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc78946e-700c-4306-8f7d-1b4d696124eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713aa787-2a62-4939-b1ef-456b2465623f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume 83304052-5600-4d83-be3c-d7a574d40768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83304052-5600-4d83-be3c-d7a574d40768', 'volume_size': 1}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (32e4f566-d195-48eb-8de1-ea8eefe2f78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52d69eb-6fc1-4e67-9f5a-abd981e07301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52d69eb-6fc1-4e67-9f5a-abd981e07301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317546176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf4a9aa-953b-4a52-98b5-baa89d1869b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:47Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5e084e-34e7-47e4-9f97-4af287d7ee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5e084e-34e7-47e4-9f97-4af287d7ee96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac18fd1-5ca0-4a4c-a216-a2d40f72cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac18fd1-5ca0-4a4c-a216-a2d40f72cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bf4a9aa-953b-4a52-98b5-baa89d1869b6', 'volume_name': 'volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34851248-8529-45ae-b85f-03d988248653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34851248-8529-45ae-b85f-03d988248653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fbf2cc-0d69-46eb-8fe9-38d03e98b7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:46 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume 1bf4a9aa-953b-4a52-98b5-baa89d1869b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6', 'volume_size': 1}
Apr 20 17:38:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:47 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35" returned: 0 in 0.452s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-385315008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d209c3ad-2002-406a-86e9-32eeddd68939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:46Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Creating volume d209c3ad-2002-406a-86e9-32eeddd68939 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:47 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d94fbe4-31d9-4134-a0bc-6577d7d9f07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d4fbe5-c5a5-4e48-b079-e1923066d57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:47 devstack sudo[89957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939 1073741824
Apr 20 17:38:47 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:47 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35 (4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35): created successfully
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d4fbe5-c5a5-4e48-b079-e1923066d57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (f51eccb3-a2fe-4642-8755-ef3fba881325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:47 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9bffb942-71ba-4cc2-b00f-629ecac8d659 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created volume successfully.
Apr 20 17:38:47 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939 1073741824" returned: 0 in 0.460s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:47 devstack sudo[89962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939
Apr 20 17:38:47 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:48 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939" returned: 0 in 0.423s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1694830218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d3c071-9c76-4bc4-bfc7-3e9108c92523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:46Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Creating volume 72d3c071-9c76-4bc4-bfc7-3e9108c92523 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:48 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b293000f-2ba9-44ab-baff-ca7597c87520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d209c3ad-2002-406a-86e9-32eeddd68939', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:48 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523 1073741824
Apr 20 17:38:48 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0334c54e-21d8-4ac0-85c5-fc5fccf28196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:48 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume volume-d209c3ad-2002-406a-86e9-32eeddd68939 (d209c3ad-2002-406a-86e9-32eeddd68939): created successfully
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0334c54e-21d8-4ac0-85c5-fc5fccf28196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (5395008c-a9f2-4bb7-bb0f-5607615535d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:48 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4ed2cecb-f03a-4621-bf48-20c1dcf0a482 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created volume successfully.
Apr 20 17:38:48 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523 1073741824" returned: 0 in 0.459s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:48 devstack sudo[89970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523
Apr 20 17:38:48 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:48 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523" returned: 0 in 0.393s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.166s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440613204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83304052-5600-4d83-be3c-d7a574d40768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:47Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Creating volume 83304052-5600-4d83-be3c-d7a574d40768 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:48 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:48 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768 1073741824
Apr 20 17:38:48 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79eca12b-d4e4-4b32-9225-8018e9996e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:48 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a77790a-20a0-4909-bc84-596180930670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:48 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523 (72d3c071-9c76-4bc4-bfc7-3e9108c92523): created successfully
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a77790a-20a0-4909-bc84-596180930670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (9d931a38-8382-4987-ac00-6fa9af02ffb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:49 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-14ee5562-0e62-4b41-8376-0cb2ea9d100a tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created volume successfully.
Apr 20 17:38:49 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768 1073741824" returned: 0 in 0.495s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:49 devstack sudo[89978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768
Apr 20 17:38:49 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:49 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768" returned: 0 in 0.408s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.913s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317546176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bf4a9aa-953b-4a52-98b5-baa89d1869b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5012ec8c60ba468eb6a600093f4f521f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:38:47Z,use_quota=True,user_id='89e455cc17c7453e8fe0b380cbf0c33e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Creating volume 1bf4a9aa-953b-4a52-98b5-baa89d1869b6 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:38:49 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713aa787-2a62-4939-b1ef-456b2465623f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83304052-5600-4d83-be3c-d7a574d40768', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:49 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6 1073741824
Apr 20 17:38:49 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb8db2b-eaf8-4821-ad07-201eab086a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:49 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume volume-83304052-5600-4d83-be3c-d7a574d40768 (83304052-5600-4d83-be3c-d7a574d40768): created successfully
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb8db2b-eaf8-4821-ad07-201eab086a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:49 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (ba6e5a4b-3452-4f13-b4ca-e20dd14d6aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:49 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4730e225-ada3-48ef-b644-9b8d18df990d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created volume successfully.
Apr 20 17:38:50 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6 1073741824" returned: 0 in 0.484s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:50 devstack sudo[89986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6
Apr 20 17:38:50 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:50 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6" returned: 0 in 0.398s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:50 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:38:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fbf2cc-0d69-46eb-8fe9-38d03e98b7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ab9b3c-7c32-4dea-b51a-75a910dee634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:38:50 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Volume volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6 (1bf4a9aa-953b-4a52-98b5-baa89d1869b6): created successfully
Apr 20 17:38:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ab9b3c-7c32-4dea-b51a-75a910dee634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:38:50 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Flow 'volume_create_manager' (32e4f566-d195-48eb-8de1-ea8eefe2f78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:38:50 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-1a468c54-c420-403d-bcbd-f7a1a2b71a17 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created volume successfully.
Apr 20 17:38:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-1bf4a9aa-953b-4a52-98b5-baa89d1869b6-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-1bf4a9aa-953b-4a52-98b5-baa89d1869b6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-quobyte-1bf4a9aa-953b-4a52-98b5-baa89d1869b6" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-1bf4a9aa-953b-4a52-98b5-baa89d1869b6" acquired by "delete_volume" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:51 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fbcc00-9aee-4186-8598-91aa0d6640de]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:51 devstack sudo[89989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6
Apr 20 17:38:51 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:51 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6" returned: 0 in 0.455s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:51 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6
Apr 20 17:38:51 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:52 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1bf4a9aa-953b-4a52-98b5-baa89d1869b6" returned: 0 in 0.414s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-1bf4a9aa-953b-4a52-98b5-baa89d1869b6" released by "delete_volume" :: held 0.892s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created reservations ['830802a8-75f9-4ea5-b033-e31363a7cfc4', '0bbc22df-907c-4b42-9cad-e986b47c99ad', 'a656979d-af2e-46c1-b10f-722e14938781', 'd0e486eb-2c9f-4aaf-858d-5ef866848277'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:52 devstack sudo[89997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:52 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-83304052-5600-4d83-be3c-d7a574d40768-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-83304052-5600-4d83-be3c-d7a574d40768-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-quobyte-83304052-5600-4d83-be3c-d7a574d40768" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-83304052-5600-4d83-be3c-d7a574d40768" acquired by "delete_volume" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ff42c1-5e7b-4b1e-857d-f2955b1303d9]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:52 devstack sudo[89999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768
Apr 20 17:38:52 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:52 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.451s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:52 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Deleted volume successfully.
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c400eb16-2ca9-41d7-8110-4757a4d4c13d tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-1bf4a9aa-953b-4a52-98b5-baa89d1869b6-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:52 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768" returned: 0 in 0.466s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:52 devstack sudo[90005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768
Apr 20 17:38:52 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:53 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-83304052-5600-4d83-be3c-d7a574d40768" returned: 0 in 0.393s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-83304052-5600-4d83-be3c-d7a574d40768" released by "delete_volume" :: held 0.878s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created reservations ['9c9afd82-46b0-4748-996b-190a97ba61ac', 'a8d173b4-6d08-408b-82bb-17633d80c84a', '0d1d6d12-57f1-4c3c-81f0-d89f27b2f191', '73cbddcb-cdce-45bb-94d4-6c281ed68aca'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:53 devstack sudo[90008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:53 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-72d3c071-9c76-4bc4-bfc7-3e9108c92523-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-72d3c071-9c76-4bc4-bfc7-3e9108c92523-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-quobyte-72d3c071-9c76-4bc4-bfc7-3e9108c92523" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-72d3c071-9c76-4bc4-bfc7-3e9108c92523" acquired by "delete_volume" :: waited 0.019s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[16588e38-d34e-4e0f-83f1-033bef1d72d8]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:53 devstack sudo[90010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523
Apr 20 17:38:53 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:53 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.428s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:53 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Deleted volume successfully.
Apr 20 17:38:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-07f92be0-e89c-4ab3-9380-3920d5622cc4 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-83304052-5600-4d83-be3c-d7a574d40768-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:54 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523" returned: 0 in 0.457s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:54 devstack sudo[90016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523
Apr 20 17:38:54 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:54 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-72d3c071-9c76-4bc4-bfc7-3e9108c92523" returned: 0 in 0.402s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-72d3c071-9c76-4bc4-bfc7-3e9108c92523" released by "delete_volume" :: held 0.879s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created reservations ['1d3ef2df-2c60-40b3-8dd9-511921202cd0', '06469f38-634e-420e-9927-d9d36757d2fb', '6c050bea-ecc5-45d3-9e7c-58647f02abe6', 'f932a455-349c-4ae2-b61a-0e95d4f130eb'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:54 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:54 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-d209c3ad-2002-406a-86e9-32eeddd68939-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-d209c3ad-2002-406a-86e9-32eeddd68939-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-quobyte-d209c3ad-2002-406a-86e9-32eeddd68939" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-d209c3ad-2002-406a-86e9-32eeddd68939" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3b8936-09e6-4665-97c6-69789ff48a66]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:54 devstack sudo[90021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939
Apr 20 17:38:54 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:54 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.430s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:54 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Deleted volume successfully.
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8b77e8c2-1b2b-4353-88a5-3f3f47f8e398 tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-72d3c071-9c76-4bc4-bfc7-3e9108c92523-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:55 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939" returned: 0 in 0.464s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:55 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939
Apr 20 17:38:55 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:55 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d209c3ad-2002-406a-86e9-32eeddd68939" returned: 0 in 0.396s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-d209c3ad-2002-406a-86e9-32eeddd68939" released by "delete_volume" :: held 0.886s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:INSERT=19,cinder:SELECT=93,cinder:UPDATE=105,cinder:DELETE=8 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created reservations ['68d05b10-bd97-442c-883e-f6a617a5d19e', '2c6342c1-7097-4b77-818f-654d5bf1c08a', 'b2e07720-f9cf-478c-9690-7f2fd56c017e', 'a57867b2-840a-4181-ae1a-0d95287e8955'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:55 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:55 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-quobyte-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[421f8191-85da-44b9-ae3a-10a16ac09a15]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:55 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35
Apr 20 17:38:55 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:56 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.424s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Deleted volume successfully.
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e5174c5f-1840-4f5b-bec5-30a399ccd5dc tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-d209c3ad-2002-406a-86e9-32eeddd68939-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:56 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35" returned: 0 in 0.466s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:56 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35
Apr 20 17:38:56 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:56 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35" returned: 0 in 0.400s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35" released by "delete_volume" :: held 0.886s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created reservations ['30914017-8d06-462e-82ef-6bbee69cf895', '1a2a8cf4-b45a-4066-8ce3-e9d0c568a270', '2e2782b4-3e90-4408-94a6-1c53291f7320', 'da033891-7625-4799-b35d-cdcf8ef7087b'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:56 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:56 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-b488bbb7-9584-4bbf-ab34-35c030917550-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-b488bbb7-9584-4bbf-ab34-35c030917550-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "cinder-quobyte-b488bbb7-9584-4bbf-ab34-35c030917550" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:38:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-b488bbb7-9584-4bbf-ab34-35c030917550" acquired by "delete_volume" :: waited 0.017s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86bf1f4-f3b1-4580-9a11-c57489663866]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:57 devstack sudo[90050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550
Apr 20 17:38:57 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:57 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.403s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:57 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Deleted volume successfully.
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-f8f6d743-c345-40b7-a2a5-161134c8bd5f tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-4c12dfa9-c6cd-4e09-8cc7-1dc78aac7a35-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:57 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550" returned: 0 in 0.469s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:57 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550
Apr 20 17:38:57 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:57 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b488bbb7-9584-4bbf-ab34-35c030917550" returned: 0 in 0.403s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-quobyte-b488bbb7-9584-4bbf-ab34-35c030917550" released by "delete_volume" :: held 0.892s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Created reservations ['89e8bed0-b349-4024-871e-0b0face86fdc', 'c2891e0b-a9cd-4264-b24f-d303c0c94b24', '79424a4f-707c-44de-94ca-4f114183fa91', '2d30d30a-28d4-4f19-b9d9-ded7af7be6dd'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:38:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:38:57 devstack sudo[90059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:38:57 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:38:58 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root
Apr 20 17:38:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.426s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:38:58 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:38:58 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Deleted volume successfully.
Apr 20 17:38:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8ed7271b-9bf4-4fba-b2ee-00eb4288e07c tempest-CreateVolumesFromSourceVolumeTest-1348527320 None] Lock "cinder-b488bbb7-9584-4bbf-ab34-35c030917550-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Flow 'volume_create_manager' (55c96068-c4dc-4178-abf4-c9821e4b04a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87b0d67-6c52-482a-8f1b-86093f16b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87b0d67-6c52-482a-8f1b-86093f16b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-86418966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceee246f-3ca0-46e9-aea8-5abc87d947d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5d8215651f45f78c8e8115de845f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:05Z,use_quota=True,user_id='f98c06bd37f64eb6a34e99972eb89581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e94bf9-d3b6-49ac-8571-b40633536731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e94bf9-d3b6-49ac-8571-b40633536731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d677ad-08c1-4321-896c-a065b63798a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d677ad-08c1-4321-896c-a065b63798a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceee246f-3ca0-46e9-aea8-5abc87d947d8', 'volume_name': 'volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f5503a-25e3-4afd-a447-3e094ff78226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f5503a-25e3-4afd-a447-3e094ff78226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af7ed29-ed7f-4a3c-99e1-715ad8436466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Volume ceee246f-3ca0-46e9-aea8-5abc87d947d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8', 'volume_size': 1}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-86418966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceee246f-3ca0-46e9-aea8-5abc87d947d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5d8215651f45f78c8e8115de845f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:05Z,use_quota=True,user_id='f98c06bd37f64eb6a34e99972eb89581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Creating volume ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:05 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:05 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 1073741824
Apr 20 17:39:05 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (d0d549cf-1c06-4b5a-aeda-bf0232a4f0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2a62c1-4e28-4f0e-8a8b-e53ede7e0adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2a62c1-4e28-4f0e-8a8b-e53ede7e0adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51168785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba310bb5-4d3c-4bbc-a577-4e4e905b876e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:05Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d977e8fb-0ae2-469f-9ec3-5d95a6bc2f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d977e8fb-0ae2-469f-9ec3-5d95a6bc2f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14329915-97e5-40bd-93c7-607eb1f350c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14329915-97e5-40bd-93c7-607eb1f350c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba310bb5-4d3c-4bbc-a577-4e4e905b876e', 'volume_name': 'volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f17a639-ac4b-4144-a391-555d67d4283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f17a639-ac4b-4144-a391-555d67d4283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad9274a-c104-4ad2-85d5-e0522e1e800e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume ba310bb5-4d3c-4bbc-a577-4e4e905b876e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e', 'volume_size': 1}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (9a7182a5-96a4-49fa-b1dd-8cbb9e4d6487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932202ff-da21-40f8-983c-9a90228d8ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932202ff-da21-40f8-983c-9a90228d8ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633153853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:05Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a6da17-795e-4f46-8a02-73b2f13318b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a6da17-795e-4f46-8a02-73b2f13318b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da29bc8d-7b2f-49d4-b28f-d98d4a963486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da29bc8d-7b2f-49d4-b28f-d98d4a963486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45', 'volume_name': 'volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76788192-af16-4d43-aa66-fa1a24964c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76788192-af16-4d43-aa66-fa1a24964c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cfb13e-5bbb-4c6a-8f67-8ddc43e355e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Volume cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45', 'volume_size': 1}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (d68041e7-be33-4823-915c-16818ae13c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1882f0-1f72-44e1-92cc-dedb06691073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1882f0-1f72-44e1-92cc-dedb06691073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1745244823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb88a098-4873-47e4-8b3a-8685e611827c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:06Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fe3f34-4082-40b3-8e75-33ae9755770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fe3f34-4082-40b3-8e75-33ae9755770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11d322c-ad5b-4d7c-9954-ececf5104b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11d322c-ad5b-4d7c-9954-ececf5104b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb88a098-4873-47e4-8b3a-8685e611827c', 'volume_name': 'volume-eb88a098-4873-47e4-8b3a-8685e611827c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7fb725-21d6-4f79-b122-53108cf38ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7fb725-21d6-4f79-b122-53108cf38ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a84424-b45f-4574-939f-bb8b8af9da3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Volume eb88a098-4873-47e4-8b3a-8685e611827c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb88a098-4873-47e4-8b3a-8685e611827c', 'volume_size': 1}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:05 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 1073741824" returned: 0 in 0.636s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:05 devstack sudo[90142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8
Apr 20 17:39:05 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (8983c5d8-b079-4923-afb4-367218517114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab40270-8635-41e4-aebe-309b560eb111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab40270-8635-41e4-aebe-309b560eb111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632754221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1263dc13-bec2-422f-961a-906e3402d6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:06Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1937d7ad-18a5-422f-bdf2-683ef4ea3477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1937d7ad-18a5-422f-bdf2-683ef4ea3477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5b997d-a241-44a2-93d8-5174ec71d195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5b997d-a241-44a2-93d8-5174ec71d195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1263dc13-bec2-422f-961a-906e3402d6c6', 'volume_name': 'volume-1263dc13-bec2-422f-961a-906e3402d6c6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695d0eaa-ab24-46e9-b768-cb13a9fcf679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695d0eaa-ab24-46e9-b768-cb13a9fcf679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153f3881-aa69-42b0-894f-732688f3a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:05 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Volume 1263dc13-bec2-422f-961a-906e3402d6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1263dc13-bec2-422f-961a-906e3402d6c6', 'volume_size': 1}
Apr 20 17:39:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (c057f9be-8aa4-482b-8467-ca2207546fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9689a5f9-b59d-4bd7-83d2-d9e7d8445497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9689a5f9-b59d-4bd7-83d2-d9e7d8445497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-628758059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7990dc05-0085-4046-9d2f-83e169747fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:06Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5621f66-8e55-4cc6-a0da-1b16ca0e4a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5621f66-8e55-4cc6-a0da-1b16ca0e4a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529d002c-9013-45b4-a576-c712431bfc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (529d002c-9013-45b4-a576-c712431bfc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7990dc05-0085-4046-9d2f-83e169747fb9', 'volume_name': 'volume-7990dc05-0085-4046-9d2f-83e169747fb9', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755b02b6-6d56-4cde-9f1e-f2003531f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (755b02b6-6d56-4cde-9f1e-f2003531f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e219afb-6376-4813-ac50-353ebbc7642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Volume 7990dc05-0085-4046-9d2f-83e169747fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7990dc05-0085-4046-9d2f-83e169747fb9', 'volume_size': 1}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (dd1376a4-8dde-4235-bca0-3a512e78febe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba46aca5-6ecd-4042-875e-433bc7876e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba46aca5-6ecd-4042-875e-433bc7876e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637780538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e70dbee-b6ff-4fd1-be4a-fea8551ddff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:06Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a5868d-59d7-4c61-8dc2-28483dc7fcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a5868d-59d7-4c61-8dc2-28483dc7fcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c28a591-2bbc-415e-aff0-2af7041e9f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c28a591-2bbc-415e-aff0-2af7041e9f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e70dbee-b6ff-4fd1-be4a-fea8551ddff1', 'volume_name': 'volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e881606e-4a32-4c1b-b321-a51dfd446b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e881606e-4a32-4c1b-b321-a51dfd446b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb7849d-9183-42cb-be14-d079f3ba3798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Volume 2e70dbee-b6ff-4fd1-be4a-fea8551ddff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1', 'volume_size': 1}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:06 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8" returned: 0 in 0.537s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.118s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51168785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba310bb5-4d3c-4bbc-a577-4e4e905b876e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:05Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Creating volume ba310bb5-4d3c-4bbc-a577-4e4e905b876e {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:06 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af7ed29-ed7f-4a3c-99e1-715ad8436466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e 1073741824
Apr 20 17:39:06 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25be5e3a-55c9-4da0-a5ac-65799fdd3bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:06 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Volume volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 (ceee246f-3ca0-46e9-aea8-5abc87d947d8): created successfully
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25be5e3a-55c9-4da0-a5ac-65799fdd3bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Flow 'volume_create_manager' (55c96068-c4dc-4178-abf4-c9821e4b04a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:06 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9b4d9808-64f8-4931-957a-5b1210aaa348 tempest-VolumeDependencyTests-1246421313 None] Created volume successfully.
Apr 20 17:39:06 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e 1073741824" returned: 0 in 0.521s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=80,cinder:INSERT=35,cinder:UPDATE=137,cinder:DELETE=14 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:39:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:06 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e
Apr 20 17:39:06 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:07 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" returned: 0 in 0.510s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.043s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633153853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:05Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Creating volume cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:07 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ad9274a-c104-4ad2-85d5-e0522e1e800e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:07 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45 1073741824
Apr 20 17:39:07 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac25213e-2297-4c2d-951e-fbc845cf6590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:07 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e (ba310bb5-4d3c-4bbc-a577-4e4e905b876e): created successfully
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac25213e-2297-4c2d-951e-fbc845cf6590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (d0d549cf-1c06-4b5a-aeda-bf0232a4f0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:07 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-edd90d2f-f9a5-468e-99b8-0dcf5d6c35e5 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created volume successfully.
Apr 20 17:39:07 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:07 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45 1073741824" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:08 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45
Apr 20 17:39:08 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:08 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45" returned: 0 in 0.577s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1745244823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb88a098-4873-47e4-8b3a-8685e611827c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:06Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Creating volume eb88a098-4873-47e4-8b3a-8685e611827c {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:08 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cfb13e-5bbb-4c6a-8f67-8ddc43e355e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:08 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c 1073741824
Apr 20 17:39:08 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b1303f-1a6e-4a96-825c-ed2125f17010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:08 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Volume volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45 (cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45): created successfully
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b1303f-1a6e-4a96-825c-ed2125f17010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:08 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (9a7182a5-96a4-49fa-b1dd-8cbb9e4d6487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:08 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-639971c7-173a-49d3-99d5-4d4b0e43ec1a tempest-CreateVolumesFromImageTest-604091720 None] Created volume successfully.
Apr 20 17:39:09 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c 1073741824" returned: 0 in 0.538s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:09 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c
Apr 20 17:39:09 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:09 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c" returned: 0 in 0.459s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.657s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-632754221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1263dc13-bec2-422f-961a-906e3402d6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:06Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Creating volume 1263dc13-bec2-422f-961a-906e3402d6c6 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:09 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a84424-b45f-4574-939f-bb8b8af9da3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb88a098-4873-47e4-8b3a-8685e611827c', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:09 devstack sudo[90170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6 1073741824
Apr 20 17:39:09 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8948440-e281-4434-a1fa-db9466585c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:09 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Volume volume-eb88a098-4873-47e4-8b3a-8685e611827c (eb88a098-4873-47e4-8b3a-8685e611827c): created successfully
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8948440-e281-4434-a1fa-db9466585c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:09 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (d68041e7-be33-4823-915c-16818ae13c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:09 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-006f8d1a-95a4-4209-bd53-a32b5ab2b6e1 tempest-CreateVolumesFromImageTest-604091720 None] Created volume successfully.
Apr 20 17:39:10 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6 1073741824" returned: 0 in 0.490s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:10 devstack sudo[90175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6
Apr 20 17:39:10 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:10 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6" returned: 0 in 0.513s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.510s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-628758059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7990dc05-0085-4046-9d2f-83e169747fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:06Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Creating volume 7990dc05-0085-4046-9d2f-83e169747fb9 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:10 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153f3881-aa69-42b0-894f-732688f3a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1263dc13-bec2-422f-961a-906e3402d6c6', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:10 devstack sudo[90178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9 1073741824
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4da9ae-058f-4e1e-87c1-ca3b83ef44e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:10 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:10 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Volume volume-1263dc13-bec2-422f-961a-906e3402d6c6 (1263dc13-bec2-422f-961a-906e3402d6c6): created successfully
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4da9ae-058f-4e1e-87c1-ca3b83ef44e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:10 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (8983c5d8-b079-4923-afb4-367218517114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:10 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-82ced43e-19b7-4106-8a14-f0dbbe8c9821 tempest-CreateVolumesFromImageTest-604091720 None] Created volume successfully.
Apr 20 17:39:11 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9 1073741824" returned: 0 in 0.537s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:11 devstack sudo[90183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9
Apr 20 17:39:11 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:11 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9" returned: 0 in 0.456s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.331s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637780538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e70dbee-b6ff-4fd1-be4a-fea8551ddff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bda675fc9d04fd1b26138943fc56c2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:06Z,use_quota=True,user_id='70bef55a2c9f4286934aeb348b7fbdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Creating volume 2e70dbee-b6ff-4fd1-be4a-fea8551ddff1 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:11 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e219afb-6376-4813-ac50-353ebbc7642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7990dc05-0085-4046-9d2f-83e169747fb9', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:11 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1 1073741824
Apr 20 17:39:11 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decaefa5-9511-4529-9a54-4ddeb7079635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:11 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Volume volume-7990dc05-0085-4046-9d2f-83e169747fb9 (7990dc05-0085-4046-9d2f-83e169747fb9): created successfully
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decaefa5-9511-4529-9a54-4ddeb7079635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:11 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (c057f9be-8aa4-482b-8467-ca2207546fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:11 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6ef08fe1-61cd-457b-85b4-dacf29d97656 tempest-CreateVolumesFromImageTest-604091720 None] Created volume successfully.
Apr 20 17:39:12 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1 1073741824" returned: 0 in 0.489s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:12 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1
Apr 20 17:39:12 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:12 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1" returned: 0 in 0.421s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.253s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb7849d-9183-42cb-be14-d079f3ba3798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd85a3e8-4547-4d9d-a12f-736c167b648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Creating offline snapshot 7b2b1da0-8bd7-42eb-b243-ea5c7c98736f of volume ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df67a0a-a39e-4279-b6d6-8b338757689a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:12 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Volume volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1 (2e70dbee-b6ff-4fd1-be4a-fea8551ddff1): created successfully
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd85a3e8-4547-4d9d-a12f-736c167b648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Flow 'volume_create_manager' (dd1376a4-8dde-4235-bca0-3a512e78febe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:12 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-735371f3-66cd-4edb-a97b-2a907f90ccb5 tempest-CreateVolumesFromImageTest-604091720 None] Created volume successfully.
Apr 20 17:39:12 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8
Apr 20 17:39:12 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-quobyte-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ba5389-525c-487b-807c-9b5b531daf4b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:12 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:13 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1
Apr 20 17:39:13 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:13 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8" returned: 0 in 0.613s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:13 devstack sudo[90201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f 1G
Apr 20 17:39:13 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:13 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1" returned: 0 in 0.511s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:13 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1
Apr 20 17:39:13 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:13 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f 1G" returned: 0 in 0.555s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:13 devstack sudo[90212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f
Apr 20 17:39:13 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:13 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:13 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1" returned: 0 in 0.523s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1" released by "delete_volume" :: held 1.075s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Created reservations ['bb198ef0-304c-447b-a943-2bd986235335', 'e1f3f170-bd91-4dbf-a2c0-7cb89c969368', '1ac86d13-232b-4b5d-9086-a37bab9fb4f7', '3b2aa002-5760-4631-b1f8-62895f319862'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:14 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:14 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:14 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f" returned: 0 in 0.475s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:14 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f is being set with open permissions: ugo+rw
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:14 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f
Apr 20 17:39:14 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:14 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.511s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:14 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Deleted volume successfully.
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b1e0cdee-4e89-4b22-a931-37fc70cca6b5 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-2e70dbee-b6ff-4fd1-be4a-fea8551ddff1-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:14 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f" returned: 0 in 0.418s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:14 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:14 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.info
Apr 20 17:39:14 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-7990dc05-0085-4046-9d2f-83e169747fb9-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-7990dc05-0085-4046-9d2f-83e169747fb9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-quobyte-7990dc05-0085-4046-9d2f-83e169747fb9" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-7990dc05-0085-4046-9d2f-83e169747fb9" acquired by "delete_volume" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bcc44a-aba8-4505-ae28-543bdbb96292]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:15 devstack sudo[90226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9
Apr 20 17:39:15 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:15 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.info" returned: 0 in 0.490s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:15 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.info is being set with open permissions: ugo+rw
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:15 devstack sudo[90229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.info
Apr 20 17:39:15 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:15 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9" returned: 0 in 0.533s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:15 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9
Apr 20 17:39:15 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:15 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.info" returned: 0 in 0.473s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.137s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.184s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Creating offline snapshot 78726074-a6eb-4d23-a545-c4ed78ad55b2 of volume ba310bb5-4d3c-4bbc-a577-4e4e905b876e {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:39:15 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-32a86541-d495-4452-b4a3-907c496500e6 tempest-VolumeDependencyTests-1246421313 None] Create snapshot completed successfully
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71b075b-8610-41aa-9215-c3c247846389]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:15 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:15 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e
Apr 20 17:39:15 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:16 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7990dc05-0085-4046-9d2f-83e169747fb9" returned: 0 in 0.454s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-7990dc05-0085-4046-9d2f-83e169747fb9" released by "delete_volume" :: held 1.018s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Created reservations ['bab58c11-42a4-4dff-bc3e-4c321001aa22', 'e1e8ed5b-31e6-48ba-9dd0-2adbd9a6cee8', '5a390fec-1999-42fa-b9ba-47b9399ba99a', 'af96a3d1-714f-4c3e-badd-91388a622f4b'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:16 devstack sudo[90244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:16 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:16 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" returned: 0 in 0.515s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:16 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 1G
Apr 20 17:39:16 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:16 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.552s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:16 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Deleted volume successfully.
Apr 20 17:39:16 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-914a8ccf-ec4a-4adb-9e65-bf75d5bba839 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-7990dc05-0085-4046-9d2f-83e169747fb9-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:17 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 1G" returned: 0 in 0.695s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:17 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2
Apr 20 17:39:17 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Flow 'volume_create_manager' (9a8b95ad-e065-4a7c-9edd-ddc01dda70ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39227b22-3ce9-4608-a508-236d2f1b81f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39227b22-3ce9-4608-a508-236d2f1b81f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-381440785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2401f7bd-736f-4fbe-b9eb-cf1317ed38ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5d8215651f45f78c8e8115de845f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b2b1da0-8bd7-42eb-b243-ea5c7c98736f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:17Z,use_quota=True,user_id='f98c06bd37f64eb6a34e99972eb89581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4077947f-3033-4389-93b4-40a1fc370eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4077947f-3033-4389-93b4-40a1fc370eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec90f1f-5462-4646-b324-08f023b6f0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec90f1f-5462-4646-b324-08f023b6f0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2401f7bd-736f-4fbe-b9eb-cf1317ed38ac', 'volume_name': 'volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac', 'volume_size': 1, 'snapshot_id': '7b2b1da0-8bd7-42eb-b243-ea5c7c98736f'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522fd4a9-5194-469b-8d43-cd4abb06feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (522fd4a9-5194-469b-8d43-cd4abb06feee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7ad12f-2bb6-46a9-9571-cc2ed4813bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:17 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Volume 2401f7bd-736f-4fbe-b9eb-cf1317ed38ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac', 'volume_size': 1, 'snapshot_id': '7b2b1da0-8bd7-42eb-b243-ea5c7c98736f'}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-1263dc13-bec2-422f-961a-906e3402d6c6-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-1263dc13-bec2-422f-961a-906e3402d6c6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-quobyte-1263dc13-bec2-422f-961a-906e3402d6c6" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-1263dc13-bec2-422f-961a-906e3402d6c6" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a28b88-d7f5-41a4-9d88-d515657235f8]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:17 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6
Apr 20 17:39:17 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:17 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2" returned: 0 in 0.552s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:17 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 is being set with open permissions: ugo+rw
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:17 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2
Apr 20 17:39:17 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:17 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6" returned: 0 in 0.574s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:17 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:17 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6
Apr 20 17:39:17 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:18 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2" returned: 0 in 0.537s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:18 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.info
Apr 20 17:39:18 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:18 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-1263dc13-bec2-422f-961a-906e3402d6c6" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-1263dc13-bec2-422f-961a-906e3402d6c6" released by "delete_volume" :: held 1.112s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Created reservations ['455c8027-4de4-4813-beb6-0dcffc65a717', 'f3a61a2d-d220-4581-8a6e-473263db2485', '02e74167-149c-4178-9a33-d67904e66cf3', '31022c70-cb10-41a3-9182-8e62801cb458'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:18 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:18 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:18 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.info" returned: 0 in 0.497s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:18 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.info is being set with open permissions: ugo+rw
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:18 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.info
Apr 20 17:39:18 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:18 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.465s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:18 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Deleted volume successfully.
Apr 20 17:39:18 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c9f71482-7b55-46df-bc1c-7a6f0eb71059 tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-1263dc13-bec2-422f-961a-906e3402d6c6-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:19 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.info" returned: 0 in 0.478s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.363s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.040s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-7b2b1da0-8bd7-42eb-b243-ea5c7c98736f-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" by "_create_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-7b2b1da0-8bd7-42eb-b243-ea5c7c98736f-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Creating volume 2401f7bd-736f-4fbe-b9eb-cf1317ed38ac from snapshot 7b2b1da0-8bd7-42eb-b243-ea5c7c98736f {{(pid=82690) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:19 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ad8b7277-f66f-4031-9b74-dca86e5eb03a tempest-CreateVolumesFromSnapshotTest-1680394951 None] Create snapshot completed successfully
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] snapshot: 7b2b1da0-8bd7-42eb-b243-ea5c7c98736f, volume: 2401f7bd-736f-4fbe-b9eb-cf1317ed38ac,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2306a-7faf-4e65-b90e-bd830e8fef1a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:19 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f
Apr 20 17:39:19 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-eb88a098-4873-47e4-8b3a-8685e611827c-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-eb88a098-4873-47e4-8b3a-8685e611827c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-quobyte-eb88a098-4873-47e4-8b3a-8685e611827c" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-eb88a098-4873-47e4-8b3a-8685e611827c" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb781cad-2be0-4ea0-a31a-ca8d48f9677c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:19 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c
Apr 20 17:39:19 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:19 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f" returned: 0 in 0.625s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93b7645-c31a-4775-95c5-aeafe242b0ea]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:19 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:19 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8
Apr 20 17:39:19 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:20 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c" returned: 0 in 0.566s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:20 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c
Apr 20 17:39:20 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (e0735bec-3334-4e85-b2ca-76d458f4893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeade2e9-131a-48d8-994e-69f34ad9fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeade2e9-131a-48d8-994e-69f34ad9fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005127358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358a0e87-2739-46dd-9f88-f9af3d85327b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:20Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83202353-fc8b-4a62-814a-169ddc35811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83202353-fc8b-4a62-814a-169ddc35811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fe6715-84b1-4c0e-91cb-bf7bfdf35303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fe6715-84b1-4c0e-91cb-bf7bfdf35303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '358a0e87-2739-46dd-9f88-f9af3d85327b', 'volume_name': 'volume-358a0e87-2739-46dd-9f88-f9af3d85327b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4197b8ed-2d44-4471-bbae-4cead5da52e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4197b8ed-2d44-4471-bbae-4cead5da52e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3242986f-3ef0-47ed-9dac-f4c5892bdefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume 358a0e87-2739-46dd-9f88-f9af3d85327b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-358a0e87-2739-46dd-9f88-f9af3d85327b', 'volume_size': 1}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:20 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8" returned: 0 in 0.571s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:20 devstack sudo[90294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac
Apr 20 17:39:20 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (86b901b1-3bd5-4d88-ae87-6024a2479ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9d06f8-032e-43b0-a02b-4ee35b3641ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9d06f8-032e-43b0-a02b-4ee35b3641ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1003082284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f460117-d9d7-4b46-83d2-4b4e46cbc311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902021d4-f2c8-44dd-8530-fe6c00739757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902021d4-f2c8-44dd-8530-fe6c00739757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68663b1-9679-495f-94a2-a0ea35234252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f68663b1-9679-495f-94a2-a0ea35234252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f460117-d9d7-4b46-83d2-4b4e46cbc311', 'volume_name': 'volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7344fd15-6f2e-4f67-8ee0-72c57a4f3818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7344fd15-6f2e-4f67-8ee0-72c57a4f3818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e19478e-0161-47b4-8d81-a1a6f0a2f037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume 8f460117-d9d7-4b46-83d2-4b4e46cbc311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311', 'volume_size': 1}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-eb88a098-4873-47e4-8b3a-8685e611827c" returned: 0 in 0.596s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-eb88a098-4873-47e4-8b3a-8685e611827c" released by "delete_volume" :: held 1.183s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Flow 'volume_create_manager' (ee244345-a6e0-4252-8975-c5b1e610fb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4180e316-b13d-417f-9d35-cac289b6c4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4180e316-b13d-417f-9d35-cac289b6c4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1465797555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9e60a1-e6b0-45f9-b6ef-125752c2c491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee53b3e274644c4686e5c6fa0c9d27e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='fa46b4d7d21b4611ae91f4ad073da1e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ea6263-16be-4d33-9605-ef3cc48fa513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ea6263-16be-4d33-9605-ef3cc48fa513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705fa802-979e-41f8-8efa-6c3b911371ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705fa802-979e-41f8-8efa-6c3b911371ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d9e60a1-e6b0-45f9-b6ef-125752c2c491', 'volume_name': 'volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebdc389-5c74-46d6-8382-51f701c41905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebdc389-5c74-46d6-8382-51f701c41905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b664ed-7e0c-4ba4-bbea-b7db388c7794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Volume 4d9e60a1-e6b0-45f9-b6ef-125752c2c491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491', 'volume_size': 1}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (94d7d7ea-4542-45f2-ad56-5f952f16a2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8754be74-02fd-4b7a-a2ab-81a1c0a871fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Created reservations ['b1b12bd9-c6c2-4b31-8045-960d65ec7754', '612d2826-fdde-4a0a-98c3-89f1edcc8ae4', '8ea512c1-aa96-4307-99aa-55ab49108ac5', 'fcf5e69a-400b-495b-a52b-b77130dda844'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8754be74-02fd-4b7a-a2ab-81a1c0a871fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1260680553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb00ff6-4c9b-4588-b4a9-86977bf742f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370b9014-0513-4200-97d2-41200fc2c663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370b9014-0513-4200-97d2-41200fc2c663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9477e6-2088-4a15-88ce-9075fa3c36b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9477e6-2088-4a15-88ce-9075fa3c36b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb00ff6-4c9b-4588-b4a9-86977bf742f2', 'volume_name': 'volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd393c2-92b6-4077-a070-ddfb46960921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd393c2-92b6-4077-a070-ddfb46960921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae98c695-fb68-46ac-b287-176ec02132a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:20 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume 7fb00ff6-4c9b-4588-b4a9-86977bf742f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2', 'volume_size': 1}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:20 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:20 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:20 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (efabdf31-ec40-40b1-9229-4a09e0b2bb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b42ac8-2c91-44ea-a023-020189461dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b42ac8-2c91-44ea-a023-020189461dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-595547024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb8e26d-84fe-4b3e-9abf-0270c930f3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abb1a38-4d23-4c30-a71f-123269d0be08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abb1a38-4d23-4c30-a71f-123269d0be08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b04a33-a9c0-4c22-a150-f1108c68c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b04a33-a9c0-4c22-a150-f1108c68c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb8e26d-84fe-4b3e-9abf-0270c930f3d7', 'volume_name': 'volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6eb04e-d21d-4b7b-b015-426a0b03555f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d6eb04e-d21d-4b7b-b015-426a0b03555f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1210253-8fe2-4553-ba98-1fc64a3099be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume 0eb8e26d-84fe-4b3e-9abf-0270c930f3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7', 'volume_size': 1}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (c13bf3f3-382a-4a5c-8a09-868b974ba259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c0c78e-f0f3-4169-8bfa-60c229170556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c0c78e-f0f3-4169-8bfa-60c229170556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1221696708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecca192-c214-4b42-bc93-efbbb1cf31f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0cfc44-c246-44fc-a0bc-8e58016f4604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0cfc44-c246-44fc-a0bc-8e58016f4604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869f1b17-be05-41c0-9257-00248b9dca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869f1b17-be05-41c0-9257-00248b9dca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ecca192-c214-4b42-bc93-efbbb1cf31f2', 'volume_name': 'volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b864253-f7d3-4641-b4be-cab65e98f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b864253-f7d3-4641-b4be-cab65e98f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e513472-e806-45b6-bc6a-b83e3b23a3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:21 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume 5ecca192-c214-4b42-bc93-efbbb1cf31f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2', 'volume_size': 1}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:21 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45-delete_volume" acquired by "delete_volume" :: waited 0.363s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "cinder-quobyte-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:22 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45" acquired by "delete_volume" :: waited 0.032s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 1.283s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:22 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Deleted volume successfully.
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da3508-e7b0-4a4b-9192-7c89ad612211]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-49b2e6f0-dcaf-4451-8bb1-f9419596848e tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-eb88a098-4873-47e4-8b3a-8685e611827c-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:22 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45
Apr 20 17:39:22 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:22 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" returned: 0 in 2.388s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a67c213-625a-4eca-88aa-8e896c2f8413]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:22 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:22 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8
Apr 20 17:39:22 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:23 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45" returned: 0 in 0.792s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:23 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45
Apr 20 17:39:23 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:23 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8" returned: 0 in 0.593s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8, size 1024.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:39:23 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Converted 1024.00 MB image at 428.72 MB/s
Apr 20 17:39:23 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac is being set with open permissions: ugo+rw
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:23 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45" returned: 0 in 0.419s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:23 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac
Apr 20 17:39:23 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-quobyte-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45" released by "delete_volume" :: held 1.262s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Created reservations ['8a571435-48e0-48be-b206-d86588fac4f4', '9490ac95-6549-4d9a-bf63-a4978610be7f', '435fd7c9-e3be-48d6-96c8-a187712cc889', '579a2458-5289-4602-b22e-84861a864e22'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:23 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:23 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:23 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" returned: 0 in 0.409s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" released by "_copy_volume_from_snapshot" :: held 4.650s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-7b2b1da0-8bd7-42eb-b243-ea5c7c98736f-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" released by "_create_volume_from_snapshot" :: held 4.670s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.688s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.467s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1005127358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358a0e87-2739-46dd-9f88-f9af3d85327b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:20Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Creating volume 358a0e87-2739-46dd-9f88-f9af3d85327b {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:23 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:23 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b 1073741824
Apr 20 17:39:23 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7ad12f-2bb6-46a9-9571-cc2ed4813bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac', 'volume_size': 1, 'snapshot_id': '7b2b1da0-8bd7-42eb-b243-ea5c7c98736f'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11191bf-b1c1-42ba-96e8-f3eec2a3ee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:23 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Volume volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac (2401f7bd-736f-4fbe-b9eb-cf1317ed38ac): created successfully
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11191bf-b1c1-42ba-96e8-f3eec2a3ee38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Flow 'volume_create_manager' (9a8b95ad-e065-4a7c-9edd-ddc01dda70ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:23 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-017aa009-5d02-4cd7-9cb8-8e317a2a20f4 tempest-VolumeDependencyTests-1246421313 None] Created volume successfully.
Apr 20 17:39:23 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.439s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:23 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Deleted volume successfully.
Apr 20 17:39:23 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-7bd68a34-80fc-44cc-bff6-4f076c7acf7f tempest-CreateVolumesFromImageTest-604091720 None] Lock "cinder-cc56350a-e8e2-4fdf-bf7c-f6c04bc1af45-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:24 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b 1073741824" returned: 0 in 0.541s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:24 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b
Apr 20 17:39:24 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-7b2b1da0-8bd7-42eb-b243-ea5c7c98736f-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-7b2b1da0-8bd7-42eb-b243-ea5c7c98736f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-ceee246f-3ca0-46e9-aea8-5abc87d947d8" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-ceee246f-3ca0-46e9-aea8-5abc87d947d8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-7b2b1da0-8bd7-42eb-b243-ea5c7c98736f" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-7b2b1da0-8bd7-42eb-b243-ea5c7c98736f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Deleting offline snapshot 7b2b1da0-8bd7-42eb-b243-ea5c7c98736f of volume ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] snapshot_file for this snap is: volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a2120f-ead9-402b-9040-33bb4613f76c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:24 devstack sudo[90338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f
Apr 20 17:39:24 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:24 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b" returned: 0 in 0.511s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.252s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1003082284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f460117-d9d7-4b46-83d2-4b4e46cbc311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Creating volume 8f460117-d9d7-4b46-83d2-4b4e46cbc311 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:24 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3242986f-3ef0-47ed-9dac-f4c5892bdefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358a0e87-2739-46dd-9f88-f9af3d85327b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:24 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263091fb-5432-4e5d-b58b-3a11586d772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:25 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume volume-358a0e87-2739-46dd-9f88-f9af3d85327b (358a0e87-2739-46dd-9f88-f9af3d85327b): created successfully
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263091fb-5432-4e5d-b58b-3a11586d772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:25 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311 1073741824
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (e0735bec-3334-4e85-b2ca-76d458f4893a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:25 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:25 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-7a4dbe53-aff1-49d2-a25e-f85b54b9124f tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created volume successfully.
Apr 20 17:39:25 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f" returned: 0 in 0.592s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6400be04-306e-40ba-bce3-0a88bdff007a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:25 devstack sudo[90346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8
Apr 20 17:39:25 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:25 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311 1073741824" returned: 0 in 0.629s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:25 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311
Apr 20 17:39:25 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (a8dae344-c8e6-4342-b8c8-3002ad5a4ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762d003c-2ed2-4656-a03a-e1c9ba8834a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762d003c-2ed2-4656-a03a-e1c9ba8834a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-671175651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ecd79b-688e-4698-8158-35cc9a6da38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:26Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:25 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877bd4df-e3f5-4f5a-94b7-c6ef8a907148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877bd4df-e3f5-4f5a-94b7-c6ef8a907148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dc2f68-c16e-4d7c-9416-bee2febebd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dc2f68-c16e-4d7c-9416-bee2febebd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ecd79b-688e-4698-8158-35cc9a6da38d', 'volume_name': 'volume-d4ecd79b-688e-4698-8158-35cc9a6da38d', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff26b53-8c67-41ee-9476-86b5646c257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff26b53-8c67-41ee-9476-86b5646c257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699be4f2-87d2-4123-abca-49e694de9450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:25 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume d4ecd79b-688e-4698-8158-35cc9a6da38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ecd79b-688e-4698-8158-35cc9a6da38d', 'volume_size': 1}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8" returned: 0 in 0.594s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:25 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:25 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f
Apr 20 17:39:25 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:26 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311" returned: 0 in 0.432s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.250s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1465797555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9e60a1-e6b0-45f9-b6ef-125752c2c491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee53b3e274644c4686e5c6fa0c9d27e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='fa46b4d7d21b4611ae91f4ad073da1e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Creating volume 4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:26 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:26 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 1073741824
Apr 20 17:39:26 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e19478e-0161-47b4-8d81-a1a6f0a2f037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2baa8a-6e8f-4c05-8067-896cc3460ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:26 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311 (8f460117-d9d7-4b46-83d2-4b4e46cbc311): created successfully
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2baa8a-6e8f-4c05-8067-896cc3460ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (86b901b1-3bd5-4d88-ae87-6024a2479ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:26 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e03b91d8-7a69-4f38-90e5-dc0c830de0af tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created volume successfully.
Apr 20 17:39:26 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f" returned: 0 in 0.449s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:26 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f
Apr 20 17:39:26 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:26 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 1073741824" returned: 0 in 0.465s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:26 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491
Apr 20 17:39:26 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:26 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8.7b2b1da0-8bd7-42eb-b243-ea5c7c98736f" returned: 0 in 0.441s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-7b2b1da0-8bd7-42eb-b243-ea5c7c98736f" released by "_delete_snapshot" :: held 2.137s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-ceee246f-3ca0-46e9-aea8-5abc87d947d8" released by "delete_snapshot" :: held 2.158s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Created reservations ['b332cc40-4020-4f52-882f-065a2103b7dc', '5b55181f-b12e-4407-85a9-f6b70f832a0c', 'e7762515-5769-43c0-943a-172647abb2c6', '3448cd42-0882-48d8-ba4f-843689fbf055'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:26 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Delete snapshot completed successfully.
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52835db5-1eca-45a6-b867-1b1da2eb840d tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-7b2b1da0-8bd7-42eb-b243-ea5c7c98736f-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:26 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" returned: 0 in 0.417s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.070s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1260680553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb00ff6-4c9b-4588-b4a9-86977bf742f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Creating volume 7fb00ff6-4c9b-4588-b4a9-86977bf742f2 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:26 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b664ed-7e0c-4ba4-bbea-b7db388c7794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:26 devstack sudo[90374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2 1073741824
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794b67b1-b325-4c59-b9b5-9ad5aeb23de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:26 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:26 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Volume volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 (4d9e60a1-e6b0-45f9-b6ef-125752c2c491): created successfully
Apr 20 17:39:26 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794b67b1-b325-4c59-b9b5-9ad5aeb23de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Flow 'volume_create_manager' (ee244345-a6e0-4252-8975-c5b1e610fb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:27 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-91faec9b-6826-42f2-90b9-a8b7bafc904f tempest-SnapshotDependencyTests-1117378302 None] Created volume successfully.
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:27 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2 1073741824" returned: 0 in 0.504s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:27 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2
Apr 20 17:39:27 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-ceee246f-3ca0-46e9-aea8-5abc87d947d8-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-ceee246f-3ca0-46e9-aea8-5abc87d947d8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-ceee246f-3ca0-46e9-aea8-5abc87d947d8" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-ceee246f-3ca0-46e9-aea8-5abc87d947d8" acquired by "delete_volume" :: waited 0.022s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4a015e-c0fa-4cfd-8034-b75b430c8642]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:27 devstack sudo[90381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8
Apr 20 17:39:27 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:27 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2" returned: 0 in 0.414s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.863s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-595547024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb8e26d-84fe-4b3e-9abf-0270c930f3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Creating volume 0eb8e26d-84fe-4b3e-9abf-0270c930f3d7 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:27 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae98c695-fb68-46ac-b287-176ec02132a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:27 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7 1073741824
Apr 20 17:39:27 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4061081d-564d-408e-be5c-f6072c693761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:27 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2 (7fb00ff6-4c9b-4588-b4a9-86977bf742f2): created successfully
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4061081d-564d-408e-be5c-f6072c693761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:27 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (94d7d7ea-4542-45f2-ad56-5f952f16a2b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:27 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-64ceb50f-b3ba-4f21-847f-5c6d61505999 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created volume successfully.
Apr 20 17:39:28 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8" returned: 0 in 0.461s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:28 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8
Apr 20 17:39:28 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:28 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7 1073741824" returned: 0 in 0.473s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:28 devstack sudo[90394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7
Apr 20 17:39:28 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:28 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ceee246f-3ca0-46e9-aea8-5abc87d947d8" returned: 0 in 0.414s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-ceee246f-3ca0-46e9-aea8-5abc87d947d8" released by "delete_volume" :: held 0.904s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Created reservations ['3a95a601-0a9c-4f82-bf5f-0c4277dee0a4', '947a480d-11c9-4f24-b75a-fa8a5d831125', 'f532fa57-e084-458e-99ac-743d104c201b', '4e6fdd04-3c31-4239-8545-b85d2100f159'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:28 devstack sudo[90397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:28 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:28 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7" returned: 0 in 0.450s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.329s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1221696708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ecca192-c214-4b42-bc93-efbbb1cf31f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04342507723d4fd5b8aa415b0a3806cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:21Z,use_quota=True,user_id='30162c84cecc4b9aa132379272c9e6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Creating volume 5ecca192-c214-4b42-bc93-efbbb1cf31f2 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:28 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1210253-8fe2-4553-ba98-1fc64a3099be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b602071-6ca8-4a89-be30-a2d282b3533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:28 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2 1073741824
Apr 20 17:39:28 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:28 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7 (0eb8e26d-84fe-4b3e-9abf-0270c930f3d7): created successfully
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b602071-6ca8-4a89-be30-a2d282b3533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:28 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (efabdf31-ec40-40b1-9229-4a09e0b2bb89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:28 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ea808b4d-3c51-435b-93a6-948f23bc4ebd tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created volume successfully.
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Flow 'volume_create_manager' (c73bdf76-b58c-4ce7-9c18-7d6efc0b71e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc6c169-b897-4120-8739-db2a6bda5047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc6c169-b897-4120-8739-db2a6bda5047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1364387704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568f70c9-f430-46ff-957b-b06d05854d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5d8215651f45f78c8e8115de845f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:29Z,use_quota=True,user_id='f98c06bd37f64eb6a34e99972eb89581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d18ea18-4f49-4a8a-b440-ab8031922574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d18ea18-4f49-4a8a-b440-ab8031922574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53db126-28b0-49be-ad51-3bc8d2e4d7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53db126-28b0-49be-ad51-3bc8d2e4d7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568f70c9-f430-46ff-957b-b06d05854d68', 'volume_name': 'volume-568f70c9-f430-46ff-957b-b06d05854d68', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9531d49c-73f7-4369-b178-0545eb1127a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9531d49c-73f7-4369-b178-0545eb1127a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f26d19-9906-4663-9339-ada84b391beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:29 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Volume 568f70c9-f430-46ff-957b-b06d05854d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568f70c9-f430-46ff-957b-b06d05854d68', 'volume_size': 1}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:29 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.459s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:29 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Deleted volume successfully.
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-cb7e8cc3-e02c-4cfd-b445-6790fd969af7 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-ceee246f-3ca0-46e9-aea8-5abc87d947d8-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:29 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2 1073741824" returned: 0 in 0.578s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:29 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2
Apr 20 17:39:29 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:29 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2" returned: 0 in 0.401s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.075s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-671175651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ecd79b-688e-4698-8158-35cc9a6da38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:26Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Creating volume d4ecd79b-688e-4698-8158-35cc9a6da38d {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:29 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e513472-e806-45b6-bc6a-b83e3b23a3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:29 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d 1073741824
Apr 20 17:39:29 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af56a6e5-61f7-41eb-8f77-f360326ed522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:29 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Volume volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2 (5ecca192-c214-4b42-bc93-efbbb1cf31f2): created successfully
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af56a6e5-61f7-41eb-8f77-f360326ed522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:29 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Flow 'volume_create_manager' (c13bf3f3-382a-4a5c-8a09-868b974ba259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:29 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-164b73e2-6c07-402f-bec4-c31a59e11b7c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created volume successfully.
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-5ecca192-c214-4b42-bc93-efbbb1cf31f2-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-5ecca192-c214-4b42-bc93-efbbb1cf31f2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-quobyte-5ecca192-c214-4b42-bc93-efbbb1cf31f2" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-5ecca192-c214-4b42-bc93-efbbb1cf31f2" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b38587-42bf-4e41-bd2a-2ead23212167]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:30 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2
Apr 20 17:39:30 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:30 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d 1073741824" returned: 0 in 0.511s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:30 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d
Apr 20 17:39:30 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:30 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2" returned: 0 in 0.473s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:30 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2
Apr 20 17:39:30 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:30 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d" returned: 0 in 0.408s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.477s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699be4f2-87d2-4123-abca-49e694de9450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ecd79b-688e-4698-8158-35cc9a6da38d', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c229362-ab8e-4039-9e1e-d01b40a958f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Creating offline snapshot faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 of volume 4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:39:30 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume volume-d4ecd79b-688e-4698-8158-35cc9a6da38d (d4ecd79b-688e-4698-8158-35cc9a6da38d): created successfully
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c229362-ab8e-4039-9e1e-d01b40a958f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (a8dae344-c8e6-4342-b8c8-3002ad5a4ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ad116-0e3d-441a-9caa-820e698596bc]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:30 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:30 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-eb3487e5-793c-4064-930c-ece578729355 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created volume successfully.
Apr 20 17:39:30 devstack sudo[90426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491
Apr 20 17:39:30 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:31 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-5ecca192-c214-4b42-bc93-efbbb1cf31f2" returned: 0 in 0.437s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-5ecca192-c214-4b42-bc93-efbbb1cf31f2" released by "delete_volume" :: held 0.941s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (30dbcbd6-448d-4e9c-9707-be963c200822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce2a929-f1b9-4bcb-a680-43f513494a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce2a929-f1b9-4bcb-a680-43f513494a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-832308246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d56a5a-83a4-4778-865f-6d0f294279a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:31Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b96691a-7451-4fe1-a5c2-34661402a68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b96691a-7451-4fe1-a5c2-34661402a68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097b7fb4-0c0b-41e9-ada9-af60c4174806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097b7fb4-0c0b-41e9-ada9-af60c4174806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d56a5a-83a4-4778-865f-6d0f294279a4', 'volume_name': 'volume-15d56a5a-83a4-4778-865f-6d0f294279a4', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da12421-b588-425a-8576-5be15bf53fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da12421-b588-425a-8576-5be15bf53fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdf06a4-a68f-4d8a-a6ac-61a5f2b32a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume 15d56a5a-83a4-4778-865f-6d0f294279a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d56a5a-83a4-4778-865f-6d0f294279a4', 'volume_size': 1}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created reservations ['87fc86e5-5364-4f86-b731-934c5c15ae44', 'c91a6e7c-63c8-4016-8352-7907d9b651e5', '42d2a66d-ff30-46da-91ce-dc97a06a4378', '43175a7f-6c27-4a96-b182-11d2dbe51b41'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:31 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:31 devstack sudo[90432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" returned: 0 in 0.563s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:31 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:31 devstack sudo[90434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 1G
Apr 20 17:39:31 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (b59d4e53-99e2-408c-8e22-1b5e06d2958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309b7178-d244-4e57-8cbe-c7ffed91d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309b7178-d244-4e57-8cbe-c7ffed91d496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2017424554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b5312b-9761-4031-99a5-357446704d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:31Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d5d38a-1426-471c-86b5-2636a593ef2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d5d38a-1426-471c-86b5-2636a593ef2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48f065d-55d6-4c75-9cdd-dbaeb56ab255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48f065d-55d6-4c75-9cdd-dbaeb56ab255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b5312b-9761-4031-99a5-357446704d1b', 'volume_name': 'volume-c3b5312b-9761-4031-99a5-357446704d1b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3d7a34-7f73-46cf-839c-d65acd3ee6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3d7a34-7f73-46cf-839c-d65acd3ee6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b87026-1799-4e2d-b45f-f19c1b3218fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume c3b5312b-9761-4031-99a5-357446704d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b5312b-9761-4031-99a5-357446704d1b', 'volume_size': 1}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (ea3509dc-2068-4a28-afad-e11e3a71081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b7c9aa-ef16-4cfe-928a-9c4c8e802dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b7c9aa-ef16-4cfe-928a-9c4c8e802dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1395607453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f53227-170c-4d61-9981-bd3ea6497606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:32Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cc47dd-c782-47db-a4d9-8d4a55c57d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04cc47dd-c782-47db-a4d9-8d4a55c57d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916d0628-2c9f-431e-a822-107ac823568b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916d0628-2c9f-431e-a822-107ac823568b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f53227-170c-4d61-9981-bd3ea6497606', 'volume_name': 'volume-b4f53227-170c-4d61-9981-bd3ea6497606', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e939df9-a42e-453c-bd71-bbd57112682a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e939df9-a42e-453c-bd71-bbd57112682a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4693a916-7810-4b28-b70d-6d938f5c2bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume b4f53227-170c-4d61-9981-bd3ea6497606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f53227-170c-4d61-9981-bd3ea6497606', 'volume_size': 1}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (1e05320b-e970-4aad-b22b-e55db8144da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d768550e-79f2-4df2-88bd-ba2ccb396541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d768550e-79f2-4df2-88bd-ba2ccb396541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1623907489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a399b04-fe04-4317-84b2-701aef0dd2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:32Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d3a282-777f-48e9-a663-660ede1c771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d3a282-777f-48e9-a663-660ede1c771d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bb00cd-88c0-4170-811b-e8a32e153572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bb00cd-88c0-4170-811b-e8a32e153572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a399b04-fe04-4317-84b2-701aef0dd2cf', 'volume_name': 'volume-9a399b04-fe04-4317-84b2-701aef0dd2cf', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8ed487-8192-4e5f-85fb-e1c4db94c7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8ed487-8192-4e5f-85fb-e1c4db94c7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed8c9e6-9157-4e2b-ba37-bad6b0e1cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:31 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume 9a399b04-fe04-4317-84b2-701aef0dd2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a399b04-fe04-4317-84b2-701aef0dd2cf', 'volume_size': 1}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.443s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:31 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Deleted volume successfully.
Apr 20 17:39:31 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-1fba4e8b-ac86-4d0b-80f4-9273bb15015b tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-5ecca192-c214-4b42-bc93-efbbb1cf31f2-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:32 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (7faa175b-9be1-45f0-ad34-429e016c7793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342e66ce-a045-49d5-a90b-5e9139a8cb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 1G" returned: 0 in 0.607s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:32 devstack sudo[90440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9
Apr 20 17:39:32 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342e66ce-a045-49d5-a90b-5e9139a8cb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-34263227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2605d070-ba02-4da3-92ee-8b897bd12e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:32Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c11bb4-f91c-4a9f-9288-4d5d103b6341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c11bb4-f91c-4a9f-9288-4d5d103b6341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0f4441-fa38-4af6-a18f-b0a1f2fd3f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e0f4441-fa38-4af6-a18f-b0a1f2fd3f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2605d070-ba02-4da3-92ee-8b897bd12e2e', 'volume_name': 'volume-2605d070-ba02-4da3-92ee-8b897bd12e2e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58631159-ffd5-4dd1-9199-ab86e79aaa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58631159-ffd5-4dd1-9199-ab86e79aaa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee00bde-c61c-4c11-8980-9b84d56ebd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:32 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume 2605d070-ba02-4da3-92ee-8b897bd12e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2605d070-ba02-4da3-92ee-8b897bd12e2e', 'volume_size': 1}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-quobyte-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71a8588-ea81-45ac-84b9-5585d5f4742e]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:32 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9" returned: 0 in 0.484s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:32 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 is being set with open permissions: ugo+rw
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:32 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7
Apr 20 17:39:32 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:32 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9
Apr 20 17:39:32 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:32 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9" returned: 0 in 0.406s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:32 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7" returned: 0 in 0.470s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:32 devstack sudo[90453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7
Apr 20 17:39:32 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:32 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:33 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.info
Apr 20 17:39:33 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:33 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7" returned: 0 in 0.422s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7" released by "delete_volume" :: held 0.916s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created reservations ['f73bb30b-40e0-449a-a6f9-10433023f8b6', 'aa7819e8-b69f-4f12-a870-a1f7c0947a72', 'f01695f6-9f7f-46bd-b5d0-5447c94dc6ea', '8ac3094e-9b70-4ec9-ab18-bc75e864caef'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:33 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.info" returned: 0 in 0.443s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:33 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.info is being set with open permissions: ugo+rw
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:33 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.info
Apr 20 17:39:33 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:33 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:33 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-7fb00ff6-4c9b-4588-b4a9-86977bf742f2-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-7fb00ff6-4c9b-4588-b4a9-86977bf742f2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-quobyte-7fb00ff6-4c9b-4588-b4a9-86977bf742f2" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-7fb00ff6-4c9b-4588-b4a9-86977bf742f2" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d47f4-9745-47b8-abe9-5d84a90d7e29]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:33 devstack sudo[90463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2
Apr 20 17:39:33 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:33 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.info" returned: 0 in 0.431s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.019s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.731s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1364387704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568f70c9-f430-46ff-957b-b06d05854d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5d8215651f45f78c8e8115de845f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:29Z,use_quota=True,user_id='f98c06bd37f64eb6a34e99972eb89581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Creating volume 568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:33 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:33 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-1ca811a3-c80c-4d2e-9499-476bb0d5f33b tempest-SnapshotDependencyTests-1117378302 None] Create snapshot completed successfully
Apr 20 17:39:33 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 1073741824
Apr 20 17:39:33 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:33 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.460s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:33 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Deleted volume successfully.
Apr 20 17:39:33 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-fdbe2e95-9ca8-4b13-bea8-a37b360a604d tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-0eb8e26d-84fe-4b3e-9abf-0270c930f3d7-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:34 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2" returned: 0 in 0.505s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:34 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2
Apr 20 17:39:34 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:34 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 1073741824" returned: 0 in 0.489s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:34 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68
Apr 20 17:39:34 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:34 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7fb00ff6-4c9b-4588-b4a9-86977bf742f2" returned: 0 in 0.460s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-7fb00ff6-4c9b-4588-b4a9-86977bf742f2" released by "delete_volume" :: held 0.985s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created reservations ['3236529c-028a-44a3-aca1-2f6e4e4baf97', 'b62d4619-2f0d-4f56-85c2-e45063be39f4', 'ef556361-078b-4f99-9e2f-7f015451ec91', 'f4dbd05e-96a0-4a83-9bd4-94bc502f2f8e'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:34 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:34 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:34 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68" returned: 0 in 0.466s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.563s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-832308246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d56a5a-83a4-4778-865f-6d0f294279a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:31Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Creating volume 15d56a5a-83a4-4778-865f-6d0f294279a4 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:34 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:34 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4 1073741824
Apr 20 17:39:34 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f26d19-9906-4663-9339-ada84b391beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568f70c9-f430-46ff-957b-b06d05854d68', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c2d552-edd4-44a8-ac29-e392a01d0f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:34 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Volume volume-568f70c9-f430-46ff-957b-b06d05854d68 (568f70c9-f430-46ff-957b-b06d05854d68): created successfully
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c2d552-edd4-44a8-ac29-e392a01d0f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Flow 'volume_create_manager' (c73bdf76-b58c-4ce7-9c18-7d6efc0b71e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:34 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-9394592b-3103-4df0-be1e-92fbb06eb8e6 tempest-VolumeDependencyTests-1246421313 None] Created volume successfully.
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Flow 'volume_create_manager' (19c96781-123c-4251-84cc-a47cd1859717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76306a4d-1955-42c4-b8ce-222db001e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76306a4d-1955-42c4-b8ce-222db001e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc77f17-fd56-43d4-b04f-415ed88e2231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee53b3e274644c4686e5c6fa0c9d27e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:35Z,use_quota=True,user_id='fa46b4d7d21b4611ae91f4ad073da1e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:34 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a7272c-93d3-4f96-9441-b023f4b012a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a7272c-93d3-4f96-9441-b023f4b012a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd91c73-6e19-4971-9c68-3ff6e214bcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd91c73-6e19-4971-9c68-3ff6e214bcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bc77f17-fd56-43d4-b04f-415ed88e2231', 'volume_name': 'volume-7bc77f17-fd56-43d4-b04f-415ed88e2231', 'volume_size': 1, 'snapshot_id': 'faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041134fc-ebd4-45c3-8fd3-880c29d726f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041134fc-ebd4-45c3-8fd3-880c29d726f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11cdf80-f9aa-48d2-924d-94c7de672d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Volume 7bc77f17-fd56-43d4-b04f-415ed88e2231: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bc77f17-fd56-43d4-b04f-415ed88e2231', 'volume_size': 1, 'snapshot_id': 'faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9'}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:35 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.455s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Deleted volume successfully.
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-a91514d3-2731-4c5a-a5c1-cced662c53d2 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-7fb00ff6-4c9b-4588-b4a9-86977bf742f2-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:35 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4 1073741824" returned: 0 in 0.514s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:35 devstack sudo[90489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4
Apr 20 17:39:35 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Flow 'volume_create_manager' (dfebe6fd-e49b-4105-b0d5-1285db12c576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f78bc5-00ee-4c39-aeb8-1a1cebbd974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f78bc5-00ee-4c39-aeb8-1a1cebbd974d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1279995579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed22232f-c838-4f23-8afb-370626d8afe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5d8215651f45f78c8e8115de845f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=568f70c9-f430-46ff-957b-b06d05854d68,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:36Z,use_quota=True,user_id='f98c06bd37f64eb6a34e99972eb89581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d069fd07-37d0-4652-b3b6-4b5c2c1b8560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d069fd07-37d0-4652-b3b6-4b5c2c1b8560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d25b2bd-2f5f-4c17-804f-92a2da3655a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d25b2bd-2f5f-4c17-804f-92a2da3655a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ed22232f-c838-4f23-8afb-370626d8afe9', 'volume_name': 'volume-ed22232f-c838-4f23-8afb-370626d8afe9', 'volume_size': 1, 'source_volid': '568f70c9-f430-46ff-957b-b06d05854d68', 'source_volstatus': 'available'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f2dc9d-b70e-4f86-9a33-0bde54d37e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f2dc9d-b70e-4f86-9a33-0bde54d37e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc4175e-1f05-4e2a-8599-7562f39c45e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Volume ed22232f-c838-4f23-8afb-370626d8afe9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ed22232f-c838-4f23-8afb-370626d8afe9', 'volume_size': 1, 'source_volid': '568f70c9-f430-46ff-957b-b06d05854d68', 'source_volstatus': 'available'}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-8f460117-d9d7-4b46-83d2-4b4e46cbc311-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-8f460117-d9d7-4b46-83d2-4b4e46cbc311-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-quobyte-8f460117-d9d7-4b46-83d2-4b4e46cbc311" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-8f460117-d9d7-4b46-83d2-4b4e46cbc311" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19cccd5-78b7-447c-b9de-2ee7d2cd5e29]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:35 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311
Apr 20 17:39:35 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:35 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4" returned: 0 in 0.461s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.321s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2017424554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b5312b-9761-4031-99a5-357446704d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:31Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Creating volume c3b5312b-9761-4031-99a5-357446704d1b {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:35 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdf06a4-a68f-4d8a-a6ac-61a5f2b32a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d56a5a-83a4-4778-865f-6d0f294279a4', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:35 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b 1073741824
Apr 20 17:39:35 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962183bf-34bd-4edd-b626-d9bccfc66f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:35 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume volume-15d56a5a-83a4-4778-865f-6d0f294279a4 (15d56a5a-83a4-4778-865f-6d0f294279a4): created successfully
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962183bf-34bd-4edd-b626-d9bccfc66f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:35 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (30dbcbd6-448d-4e9c-9707-be963c200822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:35 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-52aa9c8a-9f15-466b-bd20-f187accfdff3 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created volume successfully.
Apr 20 17:39:36 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311" returned: 0 in 0.478s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:36 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311
Apr 20 17:39:36 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:36 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b 1073741824" returned: 0 in 0.511s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:36 devstack sudo[90505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b
Apr 20 17:39:36 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:36 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-8f460117-d9d7-4b46-83d2-4b4e46cbc311" returned: 0 in 0.419s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-8f460117-d9d7-4b46-83d2-4b4e46cbc311" released by "delete_volume" :: held 0.921s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created reservations ['89f36c3e-4b7a-42bb-8877-dd4302839861', '0e87b2b4-84c2-4f16-93c7-7e363de949c4', '44429ed5-927f-4adf-88e4-3bb17c3e852e', '0d3f3e5f-1a1a-49b1-a537-3552a874b361'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:36 devstack sudo[90508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:36 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-358a0e87-2739-46dd-9f88-f9af3d85327b-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-358a0e87-2739-46dd-9f88-f9af3d85327b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:36 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b" returned: 0 in 0.442s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.114s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1395607453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f53227-170c-4d61-9981-bd3ea6497606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:32Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Creating volume b4f53227-170c-4d61-9981-bd3ea6497606 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:36 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:36 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606 1073741824
Apr 20 17:39:36 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b87026-1799-4e2d-b45f-f19c1b3218fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b5312b-9761-4031-99a5-357446704d1b', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0725ea04-3a5a-4c37-80e4-322f61a44c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-quobyte-358a0e87-2739-46dd-9f88-f9af3d85327b" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:36 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume volume-c3b5312b-9761-4031-99a5-357446704d1b (c3b5312b-9761-4031-99a5-357446704d1b): created successfully
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0725ea04-3a5a-4c37-80e4-322f61a44c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (b59d4e53-99e2-408c-8e22-1b5e06d2958f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-358a0e87-2739-46dd-9f88-f9af3d85327b" acquired by "delete_volume" :: waited 0.021s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f130e09-002e-4b55-bec8-2f47a6546e0d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:36 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:36 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-76597c35-5738-4f69-b659-15ca78b95888 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created volume successfully.
Apr 20 17:39:37 devstack sudo[90513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b
Apr 20 17:39:37 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:37 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.438s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Deleted volume successfully.
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-bdf2277b-45a2-4318-8808-99bc2a0ded22 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-8f460117-d9d7-4b46-83d2-4b4e46cbc311-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:37 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606 1073741824" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:37 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606
Apr 20 17:39:37 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:37 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b" returned: 0 in 0.528s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:37 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b
Apr 20 17:39:37 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:37 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606" returned: 0 in 0.418s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.959s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1623907489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a399b04-fe04-4317-84b2-701aef0dd2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:32Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Creating volume 9a399b04-fe04-4317-84b2-701aef0dd2cf {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:37 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4693a916-7810-4b28-b70d-6d938f5c2bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f53227-170c-4d61-9981-bd3ea6497606', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a4894e-e67e-49e0-ade9-d9e22c758161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:37 devstack sudo[90528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf 1073741824
Apr 20 17:39:37 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:37 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume volume-b4f53227-170c-4d61-9981-bd3ea6497606 (b4f53227-170c-4d61-9981-bd3ea6497606): created successfully
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a4894e-e67e-49e0-ade9-d9e22c758161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (ea3509dc-2068-4a28-afad-e11e3a71081e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:37 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-88e7dec8-5a80-4829-a880-72b910b94ed6 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created volume successfully.
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-358a0e87-2739-46dd-9f88-f9af3d85327b" returned: 0 in 0.447s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:37 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-358a0e87-2739-46dd-9f88-f9af3d85327b" released by "delete_volume" :: held 1.001s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created reservations ['c6451866-2960-499c-9025-20efe3b36509', '20d2bfba-e0d2-4853-a55c-4c5a2db891de', '47874118-6265-4382-92bb-d4b0dad289e2', 'c9624831-4457-4539-8d94-4054a03cd738'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:37 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:38 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:38 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:38 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf 1073741824" returned: 0 in 0.484s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:38 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf
Apr 20 17:39:38 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:38 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.430s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:38 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Deleted volume successfully.
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31e1cafe-e0e7-41d9-8b55-dc553c70b646 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-358a0e87-2739-46dd-9f88-f9af3d85327b-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:38 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf" returned: 0 in 0.420s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.656s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-34263227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2605d070-ba02-4da3-92ee-8b897bd12e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da966024579a4d439e8fc7a5cf62567e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:32Z,use_quota=True,user_id='674236e3a0bf4d27b471b3c8b0eab4d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Creating volume 2605d070-ba02-4da3-92ee-8b897bd12e2e {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:38 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed8c9e6-9157-4e2b-ba37-bad6b0e1cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a399b04-fe04-4317-84b2-701aef0dd2cf', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:38 devstack sudo[90539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e 1073741824
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19689555-8707-49ce-8cd5-426756b4eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:38 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:38 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume volume-9a399b04-fe04-4317-84b2-701aef0dd2cf (9a399b04-fe04-4317-84b2-701aef0dd2cf): created successfully
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19689555-8707-49ce-8cd5-426756b4eaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (1e05320b-e970-4aad-b22b-e55db8144da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:38 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-ed715408-d137-4790-bbc2-07bfbc8389c5 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created volume successfully.
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-78726074-a6eb-4d23-a545-c4ed78ad55b2-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:38 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-78726074-a6eb-4d23-a545-c4ed78ad55b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-quobyte-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-quobyte-78726074-a6eb-4d23-a545-c4ed78ad55b2" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-78726074-a6eb-4d23-a545-c4ed78ad55b2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Deleting offline snapshot 78726074-a6eb-4d23-a545-c4ed78ad55b2 of volume ba310bb5-4d3c-4bbc-a577-4e4e905b876e {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] snapshot_file for this snap is: volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1849bd-28c6-4a06-99f2-97d42fec0a60]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:39 devstack sudo[90541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2
Apr 20 17:39:39 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:39 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e 1073741824" returned: 0 in 0.488s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:39 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e
Apr 20 17:39:39 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:39 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2" returned: 0 in 0.522s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efae921-2135-49be-b0b5-072acf399534]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:39 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e
Apr 20 17:39:39 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:39 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e" returned: 0 in 0.442s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.707s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "cinder-quobyte-faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9-7bc77f17-fd56-43d4-b04f-415ed88e2231" by "_create_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee00bde-c61c-4c11-8980-9b84d56ebd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2605d070-ba02-4da3-92ee-8b897bd12e2e', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47f1ae4-51cc-4a7d-ba79-a947c7e7260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9-7bc77f17-fd56-43d4-b04f-415ed88e2231" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Creating volume 7bc77f17-fd56-43d4-b04f-415ed88e2231 from snapshot faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 {{(pid=82690) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "cinder-quobyte-7bc77f17-fd56-43d4-b04f-415ed88e2231" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:39 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Volume volume-2605d070-ba02-4da3-92ee-8b897bd12e2e (2605d070-ba02-4da3-92ee-8b897bd12e2e): created successfully
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47f1ae4-51cc-4a7d-ba79-a947c7e7260c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Flow 'volume_create_manager' (7faa175b-9be1-45f0-ad34-429e016c7793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-7bc77f17-fd56-43d4-b04f-415ed88e2231" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] snapshot: faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9, volume: 7bc77f17-fd56-43d4-b04f-415ed88e2231,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:39 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3c0751ad-953a-40f9-ae6c-65013efac0c7 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created volume successfully.
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95ae044-188c-4a39-80ac-aaa9ad132705]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:39 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:39 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9
Apr 20 17:39:39 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:40 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" returned: 0 in 0.471s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:40 devstack sudo[90559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2
Apr 20 17:39:40 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:40 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9" returned: 0 in 0.475s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac405caa-5c69-44d7-9c21-2d95ff197f81]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:40 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491
Apr 20 17:39:40 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:40 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:40 devstack sudo[90569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2
Apr 20 17:39:40 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-2605d070-ba02-4da3-92ee-8b897bd12e2e-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-2605d070-ba02-4da3-92ee-8b897bd12e2e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-quobyte-2605d070-ba02-4da3-92ee-8b897bd12e2e" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-2605d070-ba02-4da3-92ee-8b897bd12e2e" acquired by "delete_volume" :: waited 0.006s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8601d66-eeb5-4f35-935f-fa25c8ac92b0]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:40 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e
Apr 20 17:39:40 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:40 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" returned: 0 in 0.511s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231 not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:40 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231
Apr 20 17:39:40 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:40 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e.78726074-a6eb-4d23-a545-c4ed78ad55b2" returned: 0 in 0.450s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-78726074-a6eb-4d23-a545-c4ed78ad55b2" released by "_delete_snapshot" :: held 1.971s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:40 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" released by "delete_snapshot" :: held 1.982s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created reservations ['c6bb9c85-249b-43b8-9a0b-ea3c5c078bce', '4dc377ab-f433-4ebc-bdc4-df3aae6b14c5', '4daeed8a-66be-49fd-aa9b-8efb9e442bca', 'dbcf9f96-d53a-4020-ac99-f8fc7bca7551'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:41 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Delete snapshot completed successfully.
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-31c9c1e5-6084-42ea-9e43-efdcd26fdb42 tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-78726074-a6eb-4d23-a545-c4ed78ad55b2-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-ba310bb5-4d3c-4bbc-a577-4e4e905b876e-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-ba310bb5-4d3c-4bbc-a577-4e4e905b876e-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "cinder-quobyte-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" acquired by "delete_volume" :: waited 0.010s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:41 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e" returned: 0 in 0.520s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[75233624-0a39-4694-8aa4-0aecaa61d96c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:41 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:41 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e
Apr 20 17:39:41 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:41 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e
Apr 20 17:39:41 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:42 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2605d070-ba02-4da3-92ee-8b897bd12e2e" returned: 0 in 1.055s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-2605d070-ba02-4da3-92ee-8b897bd12e2e" released by "delete_volume" :: held 1.597s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created reservations ['8de022ce-0b6d-4cfd-8b71-8f89f7ee4345', '083e6d91-c9cd-46a0-b2b4-a6a5621b9082', '3db08451-6d00-45ef-a8a6-db8b330f5e60', '884bc5b0-251c-4ee8-bfde-bbc65667e1e3'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:42 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" returned: 0 in 1.273s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:42 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:42 devstack sudo[90601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:42 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:42 devstack sudo[90602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e
Apr 20 17:39:42 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-9a399b04-fe04-4317-84b2-701aef0dd2cf-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-9a399b04-fe04-4317-84b2-701aef0dd2cf-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-quobyte-9a399b04-fe04-4317-84b2-701aef0dd2cf" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-9a399b04-fe04-4317-84b2-701aef0dd2cf" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f30623-eb2c-4966-9f6e-ab5f28ed7b46]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:43 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:43 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.685s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231" returned: 0 in 2.313s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:43 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Deleted volume successfully.
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac36b70-4b96-4381-a0e8-44dd33ccc446]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-c75516dd-30b6-4d72-97bc-7be8850add87 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-2605d070-ba02-4da3-92ee-8b897bd12e2e-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:43 devstack sudo[90608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf
Apr 20 17:39:43 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:43 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491
Apr 20 17:39:43 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_service.periodic_task [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82690) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:43 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" returned: 0 in 0.787s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-quobyte-ba310bb5-4d3c-4bbc-a577-4e4e905b876e" released by "delete_volume" :: held 2.111s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:43 devstack sudo[90613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:43 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Created reservations ['801c03c7-8b98-44db-8679-a41eef08ccbd', '643ee3eb-addd-4268-876c-2ed339a7d47c', '9663b9fe-e8bb-4e4d-8f8f-d27470c0311e', '7d0b2a59-447d-443d-9b25-854071c2a2fb'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:43 devstack sudo[90615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:43 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:43 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf" returned: 0 in 0.499s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:43 devstack sudo[90622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf
Apr 20 17:39:43 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:43 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.439s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3bca6780-41a7-401b-9864-19fc82585c2b None None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:43 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" returned: 0 in 0.665s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491, size 1024.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:39:43 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Converted 1024.00 MB image at 441.85 MB/s
Apr 20 17:39:43 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231 is being set with open permissions: ugo+rw
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:43 devstack sudo[90627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231
Apr 20 17:39:43 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:43 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.432s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:43 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Deleted volume successfully.
Apr 20 17:39:43 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-b4e1ec82-5079-4fa6-90bb-31708e7f637c tempest-CreateVolumesFromSnapshotTest-1680394951 None] Lock "cinder-ba310bb5-4d3c-4bbc-a577-4e4e905b876e-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:44 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-9a399b04-fe04-4317-84b2-701aef0dd2cf" returned: 0 in 0.412s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-9a399b04-fe04-4317-84b2-701aef0dd2cf" released by "delete_volume" :: held 0.931s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created reservations ['c6359802-6c7a-497b-921e-e4884a2c08b4', '6e8290f0-e460-44e7-962c-4964ee2d2c69', 'e8d71211-4963-4000-86f0-6ede0fa8c7c1', 'a6de759b-2d41-42fa-855f-a912a14db221'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:44 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:44 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-b4f53227-170c-4d61-9981-bd3ea6497606-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-b4f53227-170c-4d61-9981-bd3ea6497606-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-quobyte-b4f53227-170c-4d61-9981-bd3ea6497606" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-b4f53227-170c-4d61-9981-bd3ea6497606" acquired by "delete_volume" :: waited 0.020s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afd8471-7f79-4f28-b49f-c5d6147d223a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:44 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231" returned: 0 in 0.445s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-7bc77f17-fd56-43d4-b04f-415ed88e2231" released by "_copy_volume_from_snapshot" :: held 4.479s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9-7bc77f17-fd56-43d4-b04f-415ed88e2231" released by "_create_volume_from_snapshot" :: held 4.508s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.545s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.578s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:44 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Cloning volume 568f70c9-f430-46ff-957b-b06d05854d68 to volume ed22232f-c838-4f23-8afb-370626d8afe9
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11cdf80-f9aa-48d2-924d-94c7de672d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc77f17-fd56-43d4-b04f-415ed88e2231', 'volume_size': 1, 'snapshot_id': 'faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5fb54e-b9c1-4345-bf60-508bbfda6928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Creating offline snapshot 09d1b444-073b-4a0e-9b47-8de122870e33 of volume 568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:39:44 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Volume volume-7bc77f17-fd56-43d4-b04f-415ed88e2231 (7bc77f17-fd56-43d4-b04f-415ed88e2231): created successfully
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5fb54e-b9c1-4345-bf60-508bbfda6928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Flow 'volume_create_manager' (19c96781-123c-4251-84cc-a47cd1859717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a75b17d-5025-46d3-889f-64584f82dd80]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:44 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606
Apr 20 17:39:44 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:44 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3ccb217f-514d-4a87-81f2-82574a398b3d tempest-SnapshotDependencyTests-1117378302 None] Created volume successfully.
Apr 20 17:39:44 devstack sudo[90635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68
Apr 20 17:39:44 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "cinder-faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "cinder-quobyte-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "cinder-quobyte-faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Deleting offline snapshot faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 of volume 4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] snapshot_file for this snap is: volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fa6de5-5b73-4241-850b-eaa0a60fbe0d]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:44 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.556s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:44 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Deleted volume successfully.
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-e01c4c57-e589-40b5-9565-a30d8aaf2baf tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-9a399b04-fe04-4317-84b2-701aef0dd2cf-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:44 devstack sudo[90638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9
Apr 20 17:39:44 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:44 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606" returned: 0 in 0.608s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:44 devstack sudo[90646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606
Apr 20 17:39:44 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:44 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68" returned: 0 in 0.580s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:44 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:44 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 1G
Apr 20 17:39:44 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:45 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-b4f53227-170c-4d61-9981-bd3ea6497606" returned: 0 in 0.456s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-b4f53227-170c-4d61-9981-bd3ea6497606" released by "delete_volume" :: held 1.086s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:45 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9" returned: 0 in 0.731s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d73fc2-8182-4403-8cb3-3bdb888cde7b]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created reservations ['fee9af96-2e7f-47be-9f13-c3f49239e0f1', 'b3cde411-929c-4ea4-9d5d-ba921e504016', '2422d367-21e2-404d-94e6-0ded16734f2f', '20c282d8-8797-4af5-ac85-082ac3c0239c'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:45 devstack sudo[90655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:45 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:45 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:45 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:45 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 1G" returned: 0 in 0.673s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568f70c9-f430-46ff-957b-b06d05854d68 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:45 devstack sudo[90662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568f70c9-f430-46ff-957b-b06d05854d68 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33
Apr 20 17:39:45 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:45 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" returned: 0 in 0.490s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:45 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9
Apr 20 17:39:45 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:45 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.441s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:45 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Deleted volume successfully.
Apr 20 17:39:45 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-6a0f8824-7ec3-4b4a-b300-5a2d44dbdf51 tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-b4f53227-170c-4d61-9981-bd3ea6497606-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:46 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568f70c9-f430-46ff-957b-b06d05854d68 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33" returned: 0 in 0.467s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:46 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 is being set with open permissions: ugo+rw
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:46 devstack sudo[90674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33
Apr 20 17:39:46 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:46 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9" returned: 0 in 0.498s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:46 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9
Apr 20 17:39:46 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-c3b5312b-9761-4031-99a5-357446704d1b-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-c3b5312b-9761-4031-99a5-357446704d1b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-quobyte-c3b5312b-9761-4031-99a5-357446704d1b" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-c3b5312b-9761-4031-99a5-357446704d1b" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eaa324-c389-402b-a894-5c3cfc5be44c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:46 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33" returned: 0 in 0.457s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:46 devstack sudo[90682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b
Apr 20 17:39:46 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:46 devstack sudo[90684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.info
Apr 20 17:39:46 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:46 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491.faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9" returned: 0 in 0.452s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9" released by "_delete_snapshot" :: held 2.231s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" released by "delete_snapshot" :: held 2.250s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Created reservations ['40bd00fe-5cad-4a3a-8ba1-67302a4f274b', '89a277d0-66de-4159-8aa2-dfb2a4e44a91', 'a2b604fd-c80d-4e70-bf7e-f3115e413970', '464aad28-d2f1-4821-aa95-c65ebdd71be2'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:46 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Delete snapshot completed successfully.
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-72a55f4f-5984-463d-9c50-3d041f0b8139 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-faebf5aa-ffd4-4b98-bf17-0bd3ede18ec9-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:46 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b" returned: 0 in 0.492s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:46 devstack sudo[90691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b
Apr 20 17:39:46 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:46 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.info" returned: 0 in 0.440s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:46 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.info is being set with open permissions: ugo+rw
Apr 20 17:39:46 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:46 devstack sudo[90693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.info
Apr 20 17:39:46 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:47 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-c3b5312b-9761-4031-99a5-357446704d1b" returned: 0 in 0.411s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-c3b5312b-9761-4031-99a5-357446704d1b" released by "delete_volume" :: held 0.937s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created reservations ['1b6d4261-2dd3-41c2-8b1c-395addc20206', 'f88d14c3-7160-45ba-a41d-2a67c6f5b9ce', 'cfa227a5-d027-44bc-b230-ff2ab0c49e10', '95678d3a-333b-426b-9894-c914d1b5808d'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:47 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.info" returned: 0 in 0.434s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-ed22232f-c838-4f23-8afb-370626d8afe9" by "_copy_volume_from_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-ed22232f-c838-4f23-8afb-370626d8afe9" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] snapshot: 09d1b444-073b-4a0e-9b47-8de122870e33, volume: ed22232f-c838-4f23-8afb-370626d8afe9,  {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6cd85c-500d-4822-be3b-f6bb8b85ffd3]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:47 devstack sudo[90698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:47 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-15d56a5a-83a4-4778-865f-6d0f294279a4-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-15d56a5a-83a4-4778-865f-6d0f294279a4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:47 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33
Apr 20 17:39:47 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-quobyte-15d56a5a-83a4-4778-865f-6d0f294279a4" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-15d56a5a-83a4-4778-865f-6d0f294279a4" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c4cdb-cf96-457d-9a28-47cbce5b3f01]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:47 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4
Apr 20 17:39:47 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "cinder-4d9e60a1-e6b0-45f9-b6ef-125752c2c491-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-4d9e60a1-e6b0-45f9-b6ef-125752c2c491-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "cinder-quobyte-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e8edb-6361-42d2-b4a8-f2d365ea2b79]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:47 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491
Apr 20 17:39:47 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:47 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.477s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:47 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Deleted volume successfully.
Apr 20 17:39:47 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33" returned: 0 in 0.527s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568f70c9-f430-46ff-957b-b06d05854d68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Creating direct copy from snapshot {{(pid=82690) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-460bc3bd-08e2-45be-b60e-809196d3593c tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-c3b5312b-9761-4031-99a5-357446704d1b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94e716a-b9e9-4bda-ad0e-84aa44aab978]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:47 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:48 devstack sudo[90709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68
Apr 20 17:39:48 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:48 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4" returned: 0 in 0.529s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:48 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4
Apr 20 17:39:48 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:48 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" returned: 0 in 0.512s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:48 devstack sudo[90719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491
Apr 20 17:39:48 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:48 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68" returned: 0 in 0.505s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG cinder.utils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Path /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9 not found in is_blk_device check {{(pid=82690) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:48 devstack sudo[90725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9
Apr 20 17:39:48 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:48 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-15d56a5a-83a4-4778-865f-6d0f294279a4" returned: 0 in 0.418s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-15d56a5a-83a4-4778-865f-6d0f294279a4" released by "delete_volume" :: held 0.976s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created reservations ['2283c267-fc56-42d4-a2de-110e94eda5e9', 'bf353c91-c5b8-4b59-bdcd-67e6c09c9a88', '6835099b-ccd4-4976-b128-ee36575e3fda', '9cd829f8-538c-4b3b-b9c7-56dfc962262f'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:48 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:48 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:48 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" returned: 0 in 0.427s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-4d9e60a1-e6b0-45f9-b6ef-125752c2c491" released by "delete_volume" :: held 0.967s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Created reservations ['9ff32686-302e-4b1c-bca2-f3e6e151a8cb', '8223c26e-5667-476c-86d7-0a1be9028301', '5aa6033e-7def-4eb3-ad6b-e4680bd3e860', 'a5c8b826-fa29-4022-b0eb-348ff17f5817'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:48 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:48 devstack sudo[90733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:48 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:49 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:49 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.774s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:49 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:49 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Deleted volume successfully.
Apr 20 17:39:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-0d772555-2d18-460d-a904-ea2e54084f7e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-15d56a5a-83a4-4778-865f-6d0f294279a4-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-d4ecd79b-688e-4698-8158-35cc9a6da38d-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-d4ecd79b-688e-4698-8158-35cc9a6da38d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:49 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "cinder-quobyte-d4ecd79b-688e-4698-8158-35cc9a6da38d" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-d4ecd79b-688e-4698-8158-35cc9a6da38d" acquired by "delete_volume" :: waited 0.023s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e7d98d-2836-46b5-8260-72c06d9cda33]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "cinder-7bc77f17-fd56-43d4-b04f-415ed88e2231-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:50 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-7bc77f17-fd56-43d4-b04f-415ed88e2231-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 1.286s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:50 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Deleted volume successfully.
Apr 20 17:39:50 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d
Apr 20 17:39:50 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8535b552-2b08-4bc6-9107-d657b6988bbb tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-4d9e60a1-e6b0-45f9-b6ef-125752c2c491-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "cinder-quobyte-7bc77f17-fd56-43d4-b04f-415ed88e2231" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-7bc77f17-fd56-43d4-b04f-415ed88e2231" acquired by "delete_volume" :: waited 0.058s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d1872a-538a-4858-9769-e4fa50e7c6d2]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:50 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231
Apr 20 17:39:50 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:50 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9" returned: 0 in 2.181s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b79b7-24fd-49c8-b6d4-b4a25dc457c8]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:50 devstack sudo[90749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68
Apr 20 17:39:50 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:50 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d" returned: 0 in 0.844s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:50 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:50 devstack sudo[90754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d
Apr 20 17:39:50 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:51 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231" returned: 0 in 0.605s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:51 devstack sudo[90759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231
Apr 20 17:39:51 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:51 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68" returned: 0 in 0.602s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.image.image_utils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9 {{(pid=82690) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 20 17:39:51 devstack cinder-volume[82690]: INFO cinder.image.image_utils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Converted 1024.00 MB image at 469.31 MB/s
Apr 20 17:39:51 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9 is being set with open permissions: ugo+rw
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:51 devstack sudo[90765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9
Apr 20 17:39:51 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:51 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-d4ecd79b-688e-4698-8158-35cc9a6da38d" returned: 0 in 0.464s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-quobyte-d4ecd79b-688e-4698-8158-35cc9a6da38d" released by "delete_volume" :: held 1.352s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Created reservations ['08fc5875-a6b9-4552-9ef2-99b5de57b81e', '8e263123-c48b-4b88-85f1-1126daa63440', 'a5f5dc34-f883-4342-975e-ba20787804bd', '1d66987c-6687-4c4d-94e5-3a58be25c2a5'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:51 devstack sudo[90768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:51 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:51 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-7bc77f17-fd56-43d4-b04f-415ed88e2231" returned: 0 in 0.438s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-quobyte-7bc77f17-fd56-43d4-b04f-415ed88e2231" released by "delete_volume" :: held 1.081s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Created reservations ['de68d7bb-c57e-4703-8e61-dfb5bd00f554', '2bb2135f-e237-4ab6-be2a-6ffb5aaaa35b', '7afa98e2-dd80-4dd6-9f8e-3607a5e9e146', '0e63ec57-a5a9-4257-bacf-38cc694c0c89'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:51 devstack sudo[90770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:51 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:51 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9" returned: 0 in 0.421s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-ed22232f-c838-4f23-8afb-370626d8afe9" released by "_copy_volume_from_snapshot" :: held 4.287s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-09d1b444-073b-4a0e-9b47-8de122870e33" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-09d1b444-073b-4a0e-9b47-8de122870e33" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Deleting offline snapshot 09d1b444-073b-4a0e-9b47-8de122870e33 of volume 568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] snapshot_file for this snap is: volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b805928-4112-4117-b6c6-36f708e82ac0]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:51 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33
Apr 20 17:39:51 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:51 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.455s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:51 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Deleted volume successfully.
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-3f7661a7-ad76-4e5b-84c4-9a3673a3c59e tempest-CreateVolumesFromSourceVolumeTest-1814750634 None] Lock "cinder-d4ecd79b-688e-4698-8158-35cc9a6da38d-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:51 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.430s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:51 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:51 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Deleted volume successfully.
Apr 20 17:39:52 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4ae8a731-d8be-4553-8ef3-5feeb66e7491 tempest-SnapshotDependencyTests-1117378302 None] Lock "cinder-7bc77f17-fd56-43d4-b04f-415ed88e2231-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:52 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33" returned: 0 in 0.483s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:52 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568f70c9-f430-46ff-957b-b06d05854d68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:39:52 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7643da-90fc-489f-85d4-71c91b8fcb9c]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:52 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68
Apr 20 17:39:52 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:52 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68" returned: 0 in 0.587s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:52 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:52 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33
Apr 20 17:39:52 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:53 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33" returned: 0 in 0.509s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:53 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33
Apr 20 17:39:53 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:53 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68.09d1b444-073b-4a0e-9b47-8de122870e33" returned: 0 in 0.446s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-09d1b444-073b-4a0e-9b47-8de122870e33" released by "_delete_snapshot" :: held 2.076s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.550s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc4175e-1f05-4e2a-8599-7562f39c45e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed22232f-c838-4f23-8afb-370626d8afe9', 'volume_size': 1, 'source_volid': '568f70c9-f430-46ff-957b-b06d05854d68', 'source_volstatus': 'available'}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ca895d-84ff-465e-8e01-6dcd04a4dfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:53 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Volume volume-ed22232f-c838-4f23-8afb-370626d8afe9 (ed22232f-c838-4f23-8afb-370626d8afe9): created successfully
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ca895d-84ff-465e-8e01-6dcd04a4dfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Flow 'volume_create_manager' (dfebe6fd-e49b-4105-b0d5-1285db12c576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:53 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-8c50469b-b3e4-4258-bdc6-8f997ccb3dd8 tempest-VolumeDependencyTests-1246421313 None] Created volume successfully.
Apr 20 17:39:53 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Flow 'volume_create_manager' (2e08365c-ecde-4a00-8d3b-fd86dba8643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76988b96-629f-42ad-986f-6757f408c62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76988b96-629f-42ad-986f-6757f408c62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc39fea0-148e-4aba-b388-475924c68649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d099cab5b5954cd1a3e34280e417b5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:54Z,use_quota=True,user_id='6c926bd94d8f419cbaa634e10eb05870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f060ed24-2473-43f3-ada3-420b3e36bb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f060ed24-2473-43f3-ada3-420b3e36bb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a1b574-3a91-4195-a66f-50c96844ac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a1b574-3a91-4195-a66f-50c96844ac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc39fea0-148e-4aba-b388-475924c68649', 'volume_name': 'volume-fc39fea0-148e-4aba-b388-475924c68649', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1450ca-0529-49fd-9a57-eebff123ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1450ca-0529-49fd-9a57-eebff123ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee9b152-7ee7-41e5-9aa5-736b5067d065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:54 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Volume fc39fea0-148e-4aba-b388-475924c68649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc39fea0-148e-4aba-b388-475924c68649', 'volume_size': 1}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc39fea0-148e-4aba-b388-475924c68649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d099cab5b5954cd1a3e34280e417b5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:54Z,use_quota=True,user_id='6c926bd94d8f419cbaa634e10eb05870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Creating volume fc39fea0-148e-4aba-b388-475924c68649 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:54 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:54 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649 1073741824
Apr 20 17:39:54 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:54 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649 1073741824" returned: 0 in 0.549s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:54 devstack sudo[90799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649
Apr 20 17:39:54 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-568f70c9-f430-46ff-957b-b06d05854d68-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-568f70c9-f430-46ff-957b-b06d05854d68-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-568f70c9-f430-46ff-957b-b06d05854d68" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-568f70c9-f430-46ff-957b-b06d05854d68" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[331aaafe-7309-474c-a876-e15df3a2bf36]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:54 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:54 devstack sudo[90801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68
Apr 20 17:39:54 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:55 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649" returned: 0 in 0.543s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee9b152-7ee7-41e5-9aa5-736b5067d065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc39fea0-148e-4aba-b388-475924c68649', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbde547-bba3-49dc-ba25-a7c5d0580063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:55 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Volume volume-fc39fea0-148e-4aba-b388-475924c68649 (fc39fea0-148e-4aba-b388-475924c68649): created successfully
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbde547-bba3-49dc-ba25-a7c5d0580063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Flow 'volume_create_manager' (2e08365c-ecde-4a00-8d3b-fd86dba8643c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:55 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-74034ff5-ea00-414c-8b68-738894c03f53 tempest-CinderUnicodeTest-1192843670 None] Created volume successfully.
Apr 20 17:39:55 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68" returned: 0 in 0.530s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:55 devstack sudo[90814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68
Apr 20 17:39:55 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:55 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-568f70c9-f430-46ff-957b-b06d05854d68" returned: 0 in 0.489s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-568f70c9-f430-46ff-957b-b06d05854d68" released by "delete_volume" :: held 1.060s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=198,cinder:INSERT=76,cinder:UPDATE=297,cinder:DELETE=30 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Created reservations ['b6edbd8f-7d96-4b1f-a5ad-632f2f25fe9f', '14dcee39-ff1b-4da8-b48f-a68f81bb83e3', '443b2a7e-5347-422e-ab18-e57e3c51f8fd', '6c91b1b4-faf3-4f07-a012-ab7ff708bed2'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:55 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:56 devstack sudo[90817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:56 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.flows.manager.create_volume [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82690) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Flow 'volume_create_manager' (017df5d7-532b-45ce-b2a3-fc99bddf8ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36a8659-4ee0-49d8-8a2b-dfed5590da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36a8659-4ee0-49d8-8a2b-dfed5590da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1801456595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f986236e-2cef-4091-88ad-15ff5d46e513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d099cab5b5954cd1a3e34280e417b5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:56Z,use_quota=True,user_id='6c926bd94d8f419cbaa634e10eb05870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d435b7-383b-40cf-8ffe-19c7b1903169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d435b7-383b-40cf-8ffe-19c7b1903169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29582c16-b628-4a0e-a298-37b8b9c0d329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29582c16-b628-4a0e-a298-37b8b9c0d329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f986236e-2cef-4091-88ad-15ff5d46e513', 'volume_name': 'volume-f986236e-2cef-4091-88ad-15ff5d46e513', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1176dc69-0c0f-4efe-a4e3-1f3c07c61145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1176dc69-0c0f-4efe-a4e3-1f3c07c61145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:56 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda5acc9-ff5e-4a61-8b36-529a45292c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:56 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Volume f986236e-2cef-4091-88ad-15ff5d46e513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f986236e-2cef-4091-88ad-15ff5d46e513', 'volume_size': 1}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff91ccffa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-20T15:39:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1801456595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f986236e-2cef-4091-88ad-15ff5d46e513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d099cab5b5954cd1a3e34280e417b5f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-20T15:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-20T15:39:56Z,use_quota=True,user_id='6c926bd94d8f419cbaa634e10eb05870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2f91c7-a95e-45a9-ada1-0109569a933c),volume_type_id=6d2f91c7-a95e-45a9-ada1-0109569a933c)}" {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Creating volume f986236e-2cef-4091-88ad-15ff5d46e513 {{(pid=82690) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Selected osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a as target Quobyte volume. {{(pid=82690) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 20 17:39:56 devstack cinder-volume[82690]: INFO cinder.volume.drivers.remotefs [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] casted to osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513 1073741824 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.520s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:56 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Deleted volume successfully.
Apr 20 17:39:56 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513 1073741824
Apr 20 17:39:56 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-4eb5beeb-8adb-40c2-b425-a09c44c5d1a1 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-568f70c9-f430-46ff-957b-b06d05854d68-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:56 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-ed22232f-c838-4f23-8afb-370626d8afe9-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-ed22232f-c838-4f23-8afb-370626d8afe9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-ed22232f-c838-4f23-8afb-370626d8afe9" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-ed22232f-c838-4f23-8afb-370626d8afe9" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbe6121-27dd-482c-b512-3129e0ff9160]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:57 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513 1073741824" returned: 0 in 0.571s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:57 devstack sudo[90828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513
Apr 20 17:39:57 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:57 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9
Apr 20 17:39:57 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:57 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513" returned: 0 in 0.488s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'} {{(pid=82690) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda5acc9-ff5e-4a61-8b36-529a45292c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f986236e-2cef-4091-88ad-15ff5d46e513', 'volume_size': 1}' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3f00fb-afa4-45ef-b05c-0c16825cac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 20 17:39:57 devstack cinder-volume[82690]: INFO cinder.volume.flows.manager.create_volume [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Volume volume-f986236e-2cef-4091-88ad-15ff5d46e513 (f986236e-2cef-4091-88ad-15ff5d46e513): created successfully
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3f00fb-afa4-45ef-b05c-0c16825cac10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82690) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Flow 'volume_create_manager' (017df5d7-532b-45ce-b2a3-fc99bddf8ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82690) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 20 17:39:57 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9" returned: 0 in 0.567s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:57 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:57 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-e059a084-3792-4d05-8920-28d1cd5f1221 tempest-CinderUnicodeTest-1192843670 None] Created volume successfully.
Apr 20 17:39:57 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9
Apr 20 17:39:57 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:58 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-ed22232f-c838-4f23-8afb-370626d8afe9" returned: 0 in 0.458s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-ed22232f-c838-4f23-8afb-370626d8afe9" released by "delete_volume" :: held 1.055s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Created reservations ['1d44ee08-db23-498e-86b1-7fe10bb8c84e', 'd0206a74-acad-43e4-bc5d-f0106a2b6ee1', '5486216a-4eff-4126-8958-c2dcd34371c7', '5cd078b5-6773-4a29-a7c0-06b76ca5cc21'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:58 devstack sudo[90839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:39:58 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:58 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.515s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:39:58 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Deleted volume successfully.
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-881982a6-eb82-4994-afe3-0bb5425c6a32 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-ed22232f-c838-4f23-8afb-370626d8afe9-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Creating offline snapshot 1c6ed136-7baf-434f-aa72-526e92e38de1 of volume f986236e-2cef-4091-88ad-15ff5d46e513 {{(pid=82690) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34d68d3-ef2d-4762-9c6d-9d0a1d0afc26]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:58 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:58 devstack sudo[90842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513
Apr 20 17:39:58 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:59 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513" returned: 0 in 0.505s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 1G {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "cinder-quobyte-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:39:59 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 1G
Apr 20 17:39:59 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" acquired by "delete_volume" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[90311fc9-7487-47f4-a73e-3e81209906b8]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:59 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac
Apr 20 17:39:59 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:59 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 1G" returned: 0 in 0.474s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f986236e-2cef-4091-88ad-15ff5d46e513 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:59 devstack sudo[90857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f986236e-2cef-4091-88ad-15ff5d46e513 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1
Apr 20 17:39:59 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:39:59 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" returned: 0 in 0.480s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:39:59 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:39:59 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac
Apr 20 17:39:59 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:00 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f986236e-2cef-4091-88ad-15ff5d46e513 -F qcow2 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1" returned: 0 in 0.419s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:00 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 is being set with open permissions: ugo+rw
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:00 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1
Apr 20 17:40:00 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:00 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" returned: 0 in 0.432s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-quobyte-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac" released by "delete_volume" :: held 0.933s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Created reservations ['629115b7-7d58-496f-af00-a4e2f57d3c47', 'ba41900d-fd12-4c5e-aaca-fb9f721ee342', '1301f717-d256-4e6b-8182-1e39138cbcf3', 'd0ac3b5b-6f0d-463d-a440-80196b1fdf88'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:00 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:40:00 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:00 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1" returned: 0 in 0.412s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:00 devstack sudo[90870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.info
Apr 20 17:40:00 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:00 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.452s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:40:00 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Deleted volume successfully.
Apr 20 17:40:00 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-227edddd-2f8e-4d2d-922e-d149c4359f84 tempest-VolumeDependencyTests-1246421313 None] Lock "cinder-2401f7bd-736f-4fbe-b9eb-cf1317ed38ac-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:40:01 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.info" returned: 0 in 0.454s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:01 devstack cinder-volume[82690]: WARNING cinder.volume.drivers.remotefs [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.info is being set with open permissions: ugo+rw
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.info {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:01 devstack sudo[90874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.info
Apr 20 17:40:01 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:01 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.info" returned: 0 in 0.438s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:40:01 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-5f980a38-e53d-439a-bcee-776c185cad49 tempest-CinderUnicodeTest-1192843670 None] Create snapshot completed successfully
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "cinder-1c6ed136-7baf-434f-aa72-526e92e38de1-delete_snapshot" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-1c6ed136-7baf-434f-aa72-526e92e38de1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "cinder-quobyte-f986236e-2cef-4091-88ad-15ff5d46e513" by "delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-quobyte-f986236e-2cef-4091-88ad-15ff5d46e513" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "cinder-quobyte-1c6ed136-7baf-434f-aa72-526e92e38de1" by "_delete_snapshot" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-quobyte-1c6ed136-7baf-434f-aa72-526e92e38de1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Deleting offline snapshot 1c6ed136-7baf-434f-aa72-526e92e38de1 of volume f986236e-2cef-4091-88ad-15ff5d46e513 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] snapshot_file for this snap is: volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 {{(pid=82690) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[7527d45a-0f0d-48f1-98ba-0e0649cde366]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:40:01 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:01 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1
Apr 20 17:40:01 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:02 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1" returned: 0 in 0.469s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:02 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.remotefs [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f986236e-2cef-4091-88ad-15ff5d46e513(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82690) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 20 17:40:02 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecfc7ec-b925-46ea-b1bb-dfd673cb6473]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:40:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:02 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513
Apr 20 17:40:02 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:02 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513" returned: 0 in 0.466s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:02 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:02 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1
Apr 20 17:40:02 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:03 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1" returned: 0 in 0.449s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:03 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1
Apr 20 17:40:03 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:03 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:03 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513.1c6ed136-7baf-434f-aa72-526e92e38de1" returned: 0 in 0.403s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-quobyte-1c6ed136-7baf-434f-aa72-526e92e38de1" released by "_delete_snapshot" :: held 1.849s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:40:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-quobyte-f986236e-2cef-4091-88ad-15ff5d46e513" released by "delete_snapshot" :: held 1.863s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:40:03 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Created reservations ['a0be8027-9690-4262-ac69-5b0c550c0a83', 'f4a59e14-e910-4962-91b0-badab67851c6', '830349a8-4478-4967-ac9f-8cbd354e22f1', 'f3005a20-bd8e-43e5-8a29-bcd8b5ac1b74'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:40:03 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Delete snapshot completed successfully.
Apr 20 17:40:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-52d90912-3461-4b02-af19-02281448a296 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-1c6ed136-7baf-434f-aa72-526e92e38de1-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:40:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "cinder-f986236e-2cef-4091-88ad-15ff5d46e513-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:40:03 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-f986236e-2cef-4091-88ad-15ff5d46e513-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:40:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "cinder-quobyte-f986236e-2cef-4091-88ad-15ff5d46e513" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:40:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-quobyte-f986236e-2cef-4091-88ad-15ff5d46e513" acquired by "delete_volume" :: waited 0.007s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:40:04 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[8602625a-6907-4b1b-8f34-6e9b32eacbf4]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:40:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:04 devstack sudo[90928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513
Apr 20 17:40:04 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:04 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513" returned: 0 in 0.478s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:04 devstack sudo[90935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513
Apr 20 17:40:04 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:04 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:04 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-f986236e-2cef-4091-88ad-15ff5d46e513" returned: 0 in 0.399s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:04 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-quobyte-f986236e-2cef-4091-88ad-15ff5d46e513" released by "delete_volume" :: held 0.906s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:40:04 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Created reservations ['256c733a-2537-4651-b504-581dd605cbf3', '1874a323-f71c-4767-9e1c-0d5daee0a99e', 'c6426e59-b2f5-4cd5-8876-dca528e80cf7', 'c8e61be8-4208-4055-a5ab-23a3f22aeb09'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:05 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:40:05 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "cinder-fc39fea0-148e-4aba-b388-475924c68649-delete_volume" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-fc39fea0-148e-4aba-b388-475924c68649-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "cinder-quobyte-fc39fea0-148e-4aba-b388-475924c68649" by "delete_volume" {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-quobyte-fc39fea0-148e-4aba-b388-475924c68649" acquired by "delete_volume" :: waited 0.008s {{(pid=82690) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6121592-0660-4902-bebb-d684ef7a9c7a]: (4, 'qcow2') {{(pid=83607) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:05 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649
Apr 20 17:40:05 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:05 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.435s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:40:05 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Deleted volume successfully.
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-151afc63-9967-4e68-b051-509a688b9340 tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-f986236e-2cef-4091-88ad-15ff5d46e513-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:40:05 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649" returned: 0 in 0.461s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:05 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649 {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:05 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649
Apr 20 17:40:05 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:06 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b/volume-fc39fea0-148e-4aba-b388-475924c68649" returned: 0 in 0.395s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-quobyte-fc39fea0-148e-4aba-b388-475924c68649" released by "delete_volume" :: held 0.877s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG cinder.quota [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Created reservations ['4a45aeae-1518-4ace-8a6d-bc1533004ddd', 'c9d33f1e-85de-4b28-b258-74e41a62664c', '9175465f-bddf-4010-a4e3-e8602e0095c4', '5df81200-a385-4e2c-b97a-8d006846c6b4'] {{(pid=82690) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a': None} {{(pid=82690) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG cinder.volume.drivers.quobyte [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-accd08da-e727-4067-a6b3-6b5ba834638a'] {{(pid=82690) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.lockutils [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82690) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 20 17:40:06 devstack sudo[90950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b
Apr 20 17:40:06 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 20 17:40:06 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG oslo_concurrency.processutils [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae25cfe227e0e9ae8ca83e388dfcad8b" returned: 0 in 0.429s {{(pid=82690) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG cinder.manager [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Notifying Schedulers of capabilities ... {{(pid=82690) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 20 17:40:06 devstack cinder-volume[82690]: INFO cinder.volume.manager [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Deleted volume successfully.
Apr 20 17:40:06 devstack cinder-volume[82690]: DEBUG cinder.coordination [None req-d6c1ccdb-5c8a-4dfc-8f21-bebcf2829aeb tempest-CinderUnicodeTest-1192843670 None] Lock "cinder-fc39fea0-148e-4aba-b388-475924c68649-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=82690) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 20 17:40:16 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:SELECT=207,cinder:UPDATE=282,cinder:INSERT=62,cinder:DELETE=21 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 20 17:40:16 devstack cinder-volume[82690]: DEBUG dbcounter [-] [82690] Writing DB stats cinder:UPDATE=47,cinder:SELECT=31,cinder:INSERT=13,cinder:DELETE=4 {{(pid=82690) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}